-- Logs begin at Thu 2022-07-21 21:33:25 UTC, end at Thu 2022-07-21 23:26:05 UTC. -- Jul 21 22:24:23.938191 dv-cinder-850696-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:24:23.946239 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:24:23 2022] *** Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: nodename: dv-cinder-850696-1-iscsi Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: machine: x86_64 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: clock source: unix Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: pcre jit disabled Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: detected number of CPU cores: 4 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: current working directory: / Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: your processes number limit is 47680 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: your memory page size is 4096 bytes Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: detected max file descriptor number: 2048 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: lock engine: pthread robust mutexes Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: thunder lock: enabled Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:24:23.952519 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:24:23.993587 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: Python main interpreter initialized at 0x56442a8ce9c0 Jul 21 22:24:23.993587 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: python threads support enabled Jul 21 22:24:23.993587 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: your server socket listen backlog is limited to 100 connections Jul 21 22:24:23.993587 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:24:23.994558 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:24:23.994674 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: *** Operational MODE: preforking *** Jul 21 22:24:23.994986 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:24:23.994986 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: spawned uWSGI master process (pid: 103342) Jul 21 22:24:23.995201 dv-cinder-850696-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:24:23.996000 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: spawned uWSGI worker 1 (pid: 103343, cores: 1) Jul 21 22:24:23.996429 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: spawned uWSGI worker 2 (pid: 103344, cores: 1) Jul 21 22:24:23.996629 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:24:24.671762 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:24:24.672384 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:24:25.811684 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:24:25.811684 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Jul 21 22:24:25.812403 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:24:25.812403 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: from cryptography.utils import int_from_bytes Jul 21 22:24:25.815253 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:24:25.815253 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jul 21 22:24:25.815681 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:24:25.815681 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: from cryptography.utils import int_from_bytes Jul 21 22:24:28.400567 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:24:28.401311 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:24:28.401482 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:24:28.401713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:24:28.401963 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:24:28.402357 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.402680 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.403002 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.403330 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.403646 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.403954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.404373 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.404619 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.404948 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.405207 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.405521 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.406042 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850696-1-iscsi {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.406155 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.406466 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.406768 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.407086 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.407389 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.407706 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.408010 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.408539 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.408980 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.409289 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.409600 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.409939 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.410253 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.410563 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.411636 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.411636 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.411636 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.411904 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.412190 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850696-1-iscsi {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.412530 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.413735 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.413735 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.413735 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.413986 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.414164 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.414483 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.414798 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.415115 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.415429 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.416309 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.416661 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.416977 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.417281 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.417595 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.417889 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.418203 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.418516 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.418820 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.419052 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.419359 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.419678 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.419992 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.420310 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.420595 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.420846 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.421164 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.421481 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.421788 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.422094 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.422398 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.422704 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.423018 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.423349 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.423621 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.423925 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.424243 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.424578 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.424902 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.425218 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.425538 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.425941 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.426190 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.426497 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.426839 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.427157 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.427467 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.427785 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.428194 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.428529 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.428837 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.429143 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.429468 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.429806 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.430119 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.430403 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.430719 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.430958 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.431446 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.431756 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.432064 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.432370 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.432696 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.433420 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.433420 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.433560 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:24:28.434107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.434203 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:24:28.434274 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.434274 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.434408 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:24:28.434485 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.434659 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:24:28.434920 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435020 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:24:28.435106 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435332 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435444 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435648 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435738 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.435972 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436059 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436280 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436375 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436610 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436715 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.436917 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.437017 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.437222 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.437542 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.437845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.438150 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.438470 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.438774 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439107 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439215 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439478 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439589 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439683 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.439771 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441031 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441143 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441281 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441375 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441582 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441684 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850696-1-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.441888 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.442206 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.442512 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.442817 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.442904 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443119 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443210 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443423 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443509 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443725 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.443810 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444026 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444113 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444325 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444415 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444651 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444740 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.444949 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445240 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445339 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445556 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445642 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445869 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.445966 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446266 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446476 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446569 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446826 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.446982 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.447601 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.447722 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.447817 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.447897 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.447990 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.448072 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.448150 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.448273 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.448380 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.448633 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.448766 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850696-1-iscsi {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.448965 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.449131 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.449285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.449573 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.449685 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.449887 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.449983 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.450211 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.450309 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.450522 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.450608 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.450832 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.450920 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.451142 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.451227 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.451459 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.451598 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.451774 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.451868 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.452104 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.452191 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.452417 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.452537 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.452760 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.452853 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.453079 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.453166 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.453387 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.453475 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.453696 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.453780 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.454012 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.454166 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.454309 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.454456 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.454727 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.454832 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.455068 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.455353 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.455449 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.455713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.455809 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.456042 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.456404 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.456670 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.456791 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.456880 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.456995 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.457161 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.457310 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.457425 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.457609 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.457730 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.462945 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463059 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.463160 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463250 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.463333 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463412 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.463507 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463596 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463769 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.463849 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.463928 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464019 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464105 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464185 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464271 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464350 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464437 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464558 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464642 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464721 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464807 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.464893 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.464985 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.465073 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.465163 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.465304 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.465390 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.465475 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.465573 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.465660 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.465750 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.465824 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.465921 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466059 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.466162 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466248 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.466330 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466417 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.466498 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466580 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.466673 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466755 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.466850 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.466934 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467014 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.467101 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467182 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.467269 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467357 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.467444 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467525 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.467623 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467748 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.467843 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.467925 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468029 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.468112 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468112 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468276 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.468405 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468405 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468682 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.468769 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.468858 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.468952 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.469033 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.469122 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.469248 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.469353 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.469462 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.469558 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.469705 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.469865 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.470003 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.470139 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.470337 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.470527 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.470687 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.470783 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.470873 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.471001 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.471188 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.471295 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.471501 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.471601 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.471816 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.471913 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.472131 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.472252 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.472456 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.472566 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.472810 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.472983 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.473131 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.473300 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.473464 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.473615 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.473760 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.473950 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.474099 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.474245 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.474348 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.474463 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.474603 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.474788 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.474909 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.475103 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.475199 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.475408 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.475508 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.475718 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.475808 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.476024 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.476123 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.476329 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.476437 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.476666 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.476764 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.476976 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.477065 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.477278 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.477384 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.477583 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.477672 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.477887 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.478012 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.478735 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.478878 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.479116 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.479440 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.479568 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.479831 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.480127 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.480300 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.480453 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.480707 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.480798 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.481081 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.481271 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.481523 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.481708 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.481936 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.482024 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.482324 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.482497 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.482635 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.482754 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.482958 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.483068 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.483291 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.483410 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.483604 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.483699 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.483916 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.484016 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.484225 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.484328 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.484571 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:24:28.484679 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.484905 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.484997 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485220 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485324 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485541 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485642 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485855 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.485964 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486181 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486307 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486488 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486586 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486816 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.486912 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487126 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487224 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487438 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487527 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487742 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.487829 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488059 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488159 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488367 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488487 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488704 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.488805 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489025 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489118 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489343 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489490 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489657 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489756 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.489973 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490077 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490282 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490370 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490594 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490700 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.490911 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491026 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491217 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491307 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491536 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491633 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.491934 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492154 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492241 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492458 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492626 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492811 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.492907 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493121 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493217 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493438 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493527 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493810 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.493889 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494125 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494210 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494439 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494524 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494752 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.494840 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495076 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495163 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495419 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495519 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495735 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.495830 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496044 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496130 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496356 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496443 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496696 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.496799 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497003 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497103 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497311 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497399 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497620 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497714 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.497932 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498028 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498242 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498330 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498552 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498646 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498855 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.498952 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499171 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499262 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499479 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499567 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499785 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.499882 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500090 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500178 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500391 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500506 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500725 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.500815 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501032 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501119 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501346 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501510 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501652 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501742 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.501956 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502049 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502262 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502349 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502583 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502671 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502890 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.502977 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503194 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503282 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503499 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503588 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503802 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.503897 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504113 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504199 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504422 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504538 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504762 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.504852 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505076 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505180 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505384 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505472 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505694 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.505781 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506010 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506109 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506317 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506456 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506632 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506720 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.506933 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507029 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507237 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507324 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507547 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507633 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507857 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.507954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508166 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508289 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508492 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508584 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508807 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.508912 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509130 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509236 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509469 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509556 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509787 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.509884 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.510125 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.510500 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.510713 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.510845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511019 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511109 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511346 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511433 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511671 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.511988 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512085 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512295 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512383 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512646 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512738 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.512955 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513045 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513262 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513357 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513566 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513662 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513877 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.513965 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514181 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514270 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514487 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514576 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514792 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.514893 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515096 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515192 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515399 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515493 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515702 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.515812 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516013 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516101 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516316 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516409 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516648 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516750 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.516952 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517040 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517260 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517353 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517564 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517665 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517867 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.517955 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518170 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518257 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518472 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518561 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518784 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.518871 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519087 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519182 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519397 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519489 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519700 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.519789 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520022 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520109 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520331 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520421 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520672 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520763 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.520976 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521073 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521280 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521374 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521601 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521689 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.521914 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522014 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522239 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522327 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522552 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522640 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522874 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.522969 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523180 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523275 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523483 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523675 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.523904 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524101 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524190 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524403 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524549 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524732 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.524822 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.525613 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.525705 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526027 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526121 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526339 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526428 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526654 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526744 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.526964 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527275 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527370 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527585 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527672 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527889 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.527977 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528201 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528289 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528521 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528612 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528839 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.528941 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529149 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529243 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529448 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529534 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529748 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.529849 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530057 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530145 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530363 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530450 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530746 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530864 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.530972 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531109 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531273 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531376 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531585 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531682 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531887 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.531976 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532187 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532274 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532498 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532602 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532810 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.532897 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533118 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533217 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533419 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533507 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533731 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.533824 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534040 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534128 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534342 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534438 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534644 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534731 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.534949 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535035 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535250 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535351 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535551 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535638 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535854 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.535949 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536167 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536256 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536500 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536603 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536807 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.536987 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537119 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537209 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537425 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537514 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537736 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.537879 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538037 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538126 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538361 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538449 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538668 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538769 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.538973 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539060 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539276 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539431 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539562 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539665 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539866 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.539954 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.540188 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.540282 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.540568 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.541269 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.541390 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.541500 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.541716 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.541914 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542033 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542229 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542353 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542583 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542671 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542894 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.542991 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543283 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543377 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543572 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543661 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543880 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.543975 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544196 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544336 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544578 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544671 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544836 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.544927 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545149 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545236 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545457 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545551 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545769 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.545866 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546081 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546180 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546394 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546488 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546698 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.546784 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547001 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547095 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547319 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547405 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547630 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.547913 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548053 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548251 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548339 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548597 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548689 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.548923 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549025 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549228 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549317 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549539 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549665 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549852 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.549941 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550161 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550256 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550473 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550572 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550785 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.550883 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551097 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551184 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551431 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551536 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551716 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.551806 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552026 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552114 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552332 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552436 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552668 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552758 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.552975 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553064 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553282 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553379 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553583 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553670 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553888 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.553977 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554194 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554293 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554499 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554595 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.554905 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555111 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555206 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555421 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555509 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555723 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.555809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.556052 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.556215 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.556466 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.556741 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.556844 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557094 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557192 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557402 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557513 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557752 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.557848 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558061 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558194 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558406 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558495 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558739 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.558827 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559043 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559133 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559378 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559486 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559685 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.559810 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560013 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560102 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560321 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560410 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560656 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560760 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.560963 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561061 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561276 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561365 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561595 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561710 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561892 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.561981 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562206 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562302 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562513 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562610 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562820 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.562907 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563129 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563218 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563414 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563513 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563725 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.563864 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564028 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564180 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564345 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564544 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564682 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.564915 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565004 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565231 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565328 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565545 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565633 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565863 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.565950 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566165 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566263 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566564 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566776 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.566864 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567089 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567186 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567394 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567483 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567697 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.567792 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568000 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568100 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568312 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568420 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568641 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568732 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.568947 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569134 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569326 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569414 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569573 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569661 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569879 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.569968 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570186 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570274 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570494 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570602 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570798 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.570927 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571099 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571240 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571407 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571566 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571731 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.571999 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572102 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572225 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572372 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572555 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572870 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.572957 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573176 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573263 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573483 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573584 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573787 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.573874 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574095 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574182 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574398 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574492 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574702 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.574790 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575008 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575097 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575306 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575393 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575604 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575692 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.575925 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576012 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576227 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576323 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576563 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576652 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576872 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.576961 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577175 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577264 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577502 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577589 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577807 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.577895 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578131 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578220 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578439 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578526 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578742 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.578837 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579046 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579136 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579349 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579448 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579662 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579775 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.579978 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580065 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580289 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580378 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580638 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580741 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.580956 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581044 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581264 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581358 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581568 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581663 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581872 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.581960 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582195 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582298 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582505 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582606 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582818 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.582915 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583119 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583214 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583422 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583511 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583728 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.583816 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584031 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584128 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584334 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584423 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584660 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584752 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.584966 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585061 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585266 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585362 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585572 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585662 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585871 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.585971 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586183 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586279 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586484 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586573 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586795 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.586882 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.587099 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.587200 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.587963 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588069 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588219 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588385 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588544 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588807 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.588899 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589117 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589205 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589446 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589534 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589759 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.589849 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590066 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590209 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590383 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590472 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590691 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.590782 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591004 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591093 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591347 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591445 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591635 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591746 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.591951 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592060 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592270 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592380 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592606 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592714 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.592923 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593012 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593238 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593336 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593547 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593862 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.593957 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.594178 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.594276 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.594494 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.594582 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.594890 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595065 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595203 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595398 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595515 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595712 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.595821 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596024 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596125 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596334 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596438 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596672 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596762 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.596988 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597094 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597297 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597387 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597607 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597702 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.597917 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598014 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598225 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598328 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598545 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598632 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598864 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.598967 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599190 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599280 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599525 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599613 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599842 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.599953 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600158 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600283 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600472 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600603 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600806 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.600897 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601165 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601258 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601480 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601577 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601785 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.601872 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602099 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602194 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602409 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602520 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602719 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.602806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.603056 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.603650 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.603894 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604121 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604210 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604446 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604616 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604780 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.604869 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605109 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605208 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605437 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605526 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605750 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.605846 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606072 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606168 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606406 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606501 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606726 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.606839 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607040 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607128 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607353 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607442 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607668 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.607765 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608015 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608188 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608321 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608525 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608664 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608862 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.608947 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609188 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609284 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609512 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609656 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609831 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.609921 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610148 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610236 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610457 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610554 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610768 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.610863 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611070 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611157 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611371 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611470 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611678 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611765 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.611981 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612069 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612304 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612394 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612636 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612729 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.612941 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613028 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613261 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613351 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613563 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613649 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.613886 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614095 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614192 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614447 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614536 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614764 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.614852 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615067 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615167 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615408 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615502 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615712 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.615798 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616016 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616110 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616339 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616427 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616671 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616774 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.616976 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617067 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617289 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617377 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617597 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617685 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617900 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.617990 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618202 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618291 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618511 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618618 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.618934 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619147 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619308 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619489 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619653 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619739 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.619821 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620043 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620131 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620345 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620440 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620673 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620763 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.620975 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621075 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621281 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621384 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621583 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621670 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621887 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.621975 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622190 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622287 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622494 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622581 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622804 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.622891 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623197 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623411 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623509 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623711 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.623799 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624022 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624118 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624322 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624411 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624656 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.624746 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625002 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625091 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625326 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625415 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625631 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625717 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.625937 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626033 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626253 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626351 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626565 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626662 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626877 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.626964 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627186 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627272 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627498 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627593 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627812 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.627900 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.628127 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.628221 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.628442 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.628696 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.628788 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629030 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629125 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629350 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629439 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629679 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.629809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630007 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630250 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630338 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630578 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630669 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630893 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.630989 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631205 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631292 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631514 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631602 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631824 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.631913 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632134 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632221 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632442 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632551 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632774 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.632861 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633082 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633183 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633388 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633475 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633696 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.633785 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634004 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634101 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634480 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634761 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634851 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.634937 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635007 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635091 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635496 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635588 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.635898 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636144 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636232 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636461 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636607 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636799 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.636901 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637116 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637206 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637427 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637524 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637733 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.637821 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638040 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638130 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638347 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638442 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638655 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638751 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.638967 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639055 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639277 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639381 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639586 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639689 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639889 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.639977 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640208 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640303 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640553 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640659 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640878 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.640969 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641211 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641300 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641531 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641621 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641845 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.641933 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642164 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642281 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642473 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642571 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642794 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.642991 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643104 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643306 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643432 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643639 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643772 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.643964 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644100 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644286 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644423 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644633 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644736 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.644953 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645041 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645282 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645372 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645587 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645682 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645892 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.645984 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646204 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646294 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646512 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646607 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646814 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.646901 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647120 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647209 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647423 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647518 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647724 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.647820 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648021 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648109 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648321 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648409 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648650 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648885 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.648977 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.649234 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.649371 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.649533 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.649629 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.650491 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.650647 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.650743 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.650877 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.650963 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651053 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651271 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651369 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651573 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651662 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651877 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.651978 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652178 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652275 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652499 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652591 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652804 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.652906 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653108 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653199 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653413 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653502 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653727 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.653825 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654038 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654125 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654341 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654437 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654653 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654743 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.654958 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655045 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655276 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655367 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655579 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655885 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.655980 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656175 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656268 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656501 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656610 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656812 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.656901 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657116 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657204 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657420 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657516 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657722 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.657811 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.658029 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.658124 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.658329 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.658416 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659299 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659448 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659540 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659634 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659718 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659801 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659897 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.659981 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660062 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660151 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660241 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660324 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660491 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660640 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660804 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.660902 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661110 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661200 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661423 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661511 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661729 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.661827 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662032 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662120 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662342 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662431 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662650 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662739 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.662961 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663049 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663271 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663377 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663579 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663835 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.663924 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664167 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664256 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664519 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664613 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664839 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.664927 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665150 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665239 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665457 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665594 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665815 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.665963 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666121 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666395 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666510 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666631 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666741 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.666979 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667068 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667309 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667412 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667625 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667715 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.667938 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.668026 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.668243 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.668340 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.668498 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:24:28.668590 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.668883 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.669194 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.669503 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.669812 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.670122 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.670437 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.670750 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.671093 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.671416 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.671733 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.672049 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.672367 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.672703 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.673016 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.673322 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.673631 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.673947 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.674275 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.674589 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.674892 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.675315 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.675628 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.675947 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.676265 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.676596 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.676918 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.677238 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.677548 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.677868 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.678176 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.678503 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.678843 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.679171 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.679492 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.679796 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.680100 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.680409 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.680747 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.681207 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.681700 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.681700 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.682032 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.682326 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.682633 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.682941 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.683245 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.683547 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.683853 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.684156 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.684460 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.684785 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.685089 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.685393 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.685696 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.686003 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.686306 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.686610 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.686911 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.687215 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.687517 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.687846 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.688179 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.688511 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.688835 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.689146 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.689468 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.689777 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.690099 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.690427 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.690752 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.691059 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.691393 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.691703 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.692016 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.692330 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.692669 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.692979 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.693291 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.693620 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.693944 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.694248 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.694579 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.694892 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.695212 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.695526 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.695837 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.696165 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.696498 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.697328 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.697665 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.697950 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.698256 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.698569 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.698879 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.699507 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.699823 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.700153 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.700513 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.700817 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.701144 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.701471 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.701826 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.702139 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.702485 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.702813 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.703127 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.703442 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.703746 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:24:28.703990 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103343) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:24:28.731797 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Registered counter for database nova_api Jul 21 22:24:28.768384 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Registered counter for database nova_api Jul 21 22:24:28.844441 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.851642 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:28.878671 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.886077 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:28.909748 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.context [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4803857f-df2d-488f-a38b-a8f790f3829e(cell1) {{(pid=103344) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:24:28.913704 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.915309 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.916645 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.918782 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.920802 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Registered counter for database nova_cell0 Jul 21 22:24:28.924700 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Registered counter for database nova_cell1 Jul 21 22:24:28.932604 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.935162 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.939258 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:28.943599 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.context [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4803857f-df2d-488f-a38b-a8f790f3829e(cell1) {{(pid=103343) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:24:28.947628 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.949277 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.950096 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.952208 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_concurrency.lockutils [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103343) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.954247 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Registered counter for database nova_cell0 Jul 21 22:24:28.958202 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Registered counter for database nova_cell1 Jul 21 22:24:28.967945 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.970444 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:28.975572 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:28.978721 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:29.081872 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:29.097580 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO dbcounter [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Registered counter for database nova_cell0 Jul 21 22:24:29.108514 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_db.sqlalchemy.engines [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:29.113841 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writer thread running {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:29.128688 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO dbcounter [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Registered counter for database nova_cell0 Jul 21 22:24:29.138818 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG oslo_db.sqlalchemy.engines [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103343) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:24:29.143663 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writer thread running {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:24:29.458587 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:24:29.466647 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:24:29.467059 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:24:29.474550 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:24:29.816809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:24:29.822247 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:24:29.822978 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: WARNING keystonemiddleware.auth_token [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:24:29.828326 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56442a8ce9c0 pid: 103344 (default app) Jul 21 22:24:29.828443 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: WARNING keystonemiddleware.auth_token [None req-016a1f54-9650-4705-b5eb-8692737e725b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:24:29.830465 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:29.831665 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jul 21 22:24:29.833685 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Jul 21 22:24:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:24:29.833821 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56442a8ce9c0 pid: 103343 (default app) Jul 21 22:25:52.346882 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:52.350474 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004851 Jul 21 22:25:52.352080 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:25:52.368910 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.370151 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell1:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.371159 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:52.372006 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_cell0:SELECT=3 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:53.484791 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f9e62fd0-f33b-4250-af5f-f84dda15b6ef admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:53.521354 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f9e62fd0-f33b-4250-af5f-f84dda15b6ef admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.158125 Jul 21 22:25:53.524650 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 22:25:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:56.130116 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:56.130965 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-6f20ee49-e5a7-4d49-a0b2-7cd240f8c5b3 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 21 22:25:56.132890 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:25:56.649949 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-0f91ca21-454b-4660-84e3-71e1f9b2288a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:56.685828 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:56.685828 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jul 21 22:25:56.735623 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-0f91ca21-454b-4660-84e3-71e1f9b2288a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.597621 Jul 21 22:25:56.736626 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:25:56.760824 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:56.762787 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:56.763936 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=3 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:56.765108 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.054827 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-1ffb18e9-0b9e-43e2-8c54-eb2a9b46010b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:25:57.057413 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:25:57.057413 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:25:57.165351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-1ffb18e9-0b9e-43e2-8c54-eb2a9b46010b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.413281 Jul 21 22:25:57.166949 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 22:25:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:59.567466 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-0f91ca21-454b-4660-84e3-71e1f9b2288a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:59.569294 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-0f91ca21-454b-4660-84e3-71e1f9b2288a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002270 Jul 21 22:25:59.569793 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:00.503174 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-bd0e8a91-eeef-4288-a8ff-0652eb96d943 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0, "id": "d1"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:00.523965 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:26:00.523965 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:26:00.550918 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-bd0e8a91-eeef-4288-a8ff-0652eb96d943 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.973911 Jul 21 22:26:00.552391 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:25:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:00.568667 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ee76d2b3-2467-4ed7-bf41-f3e838ca295b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:00.571509 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:26:00.571509 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: warnings.warn(msg) Jul 21 22:26:00.613146 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ee76d2b3-2467-4ed7-bf41-f3e838ca295b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049358 Jul 21 22:26:00.614759 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 22:26:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:03.196340 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-bd0e8a91-eeef-4288-a8ff-0652eb96d943 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:03.197470 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-bd0e8a91-eeef-4288-a8ff-0652eb96d943 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Jul 21 22:26:03.197877 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:03.616062 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-71c6bb9b-8b13-4fd9-ac93-b52c0cc3953e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:03.641386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-71c6bb9b-8b13-4fd9-ac93-b52c0cc3953e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436585 Jul 21 22:26:03.649579 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:03.654008 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0b3bf2ce-1659-46ee-a7bc-0f0e1cd9a0ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:03.679093 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-0b3bf2ce-1659-46ee-a7bc-0f0e1cd9a0ee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028835 Jul 21 22:26:03.679809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 22:26:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:06.054557 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-71c6bb9b-8b13-4fd9-ac93-b52c0cc3953e admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:06.055056 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-71c6bb9b-8b13-4fd9-ac93-b52c0cc3953e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 21 22:26:06.055334 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:06.592343 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-efd75483-b330-4fa2-b04f-88524e588d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:06.626633 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-efd75483-b330-4fa2-b04f-88524e588d08 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.564294 Jul 21 22:26:06.627800 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:06.641529 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-a99674fd-92b1-46aa-ac51-1de51e61d773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:06.668834 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-a99674fd-92b1-46aa-ac51-1de51e61d773 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031156 Jul 21 22:26:06.670050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 22:26:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:08.970502 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-efd75483-b330-4fa2-b04f-88524e588d08 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:08.971528 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-efd75483-b330-4fa2-b04f-88524e588d08 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 21 22:26:08.971936 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:09.439806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "disk": 20}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:09.459713 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480912 Jul 21 22:26:09.460281 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:09.473655 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-3dd65172-04c4-4842-add8-5827e666a0a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:09.498205 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-3dd65172-04c4-4842-add8-5827e666a0a0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028774 Jul 21 22:26:09.498904 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1335 bytes} [Thu Jul 21 22:26:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:11.842864 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:11.844232 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jul 21 22:26:11.844819 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:12.360961 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d88c1be3-714f-45bf-bee2-28cda0ad0477 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:12.393644 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d88c1be3-714f-45bf-bee2-28cda0ad0477 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.539260 Jul 21 22:26:12.394373 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 22:26:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:15.029147 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:15.030396 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-263e6187-11f6-4408-966d-58ea40446488 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jul 21 22:26:15.030872 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:15.484636 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-686f46b0-bfe7-4690-b9c2-e36ec6fafb55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "swap": 0, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:15.503748 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-686f46b0-bfe7-4690-b9c2-e36ec6fafb55 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.466182 Jul 21 22:26:15.504320 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:15.519169 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-f3312dc6-cddb-435e-b702-df26381154e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:15.545065 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-f3312dc6-cddb-435e-b702-df26381154e6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029436 Jul 21 22:26:15.545790 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 22:26:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:17.984408 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-686f46b0-bfe7-4690-b9c2-e36ec6fafb55 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:17.985473 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-686f46b0-bfe7-4690-b9c2-e36ec6fafb55 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 21 22:26:17.985869 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:18.452315 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-04485a7f-dfec-4c79-a7ba-f74fc3b60a69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "swap": 0, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:18.471563 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-04485a7f-dfec-4c79-a7ba-f74fc3b60a69 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479529 Jul 21 22:26:18.472227 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:18.484731 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-2a6dfa03-a22a-415b-a2c1-b9a656a1c344 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:18.507946 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-2a6dfa03-a22a-415b-a2c1-b9a656a1c344 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026985 Jul 21 22:26:18.508845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 22:26:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:20.830274 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-04485a7f-dfec-4c79-a7ba-f74fc3b60a69 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:20.831286 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-04485a7f-dfec-4c79-a7ba-f74fc3b60a69 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 21 22:26:20.831668 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:21.280003 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-ce5fdc00-251d-4eb6-9959-e1aaf8b3db68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:21.302491 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-ce5fdc00-251d-4eb6-9959-e1aaf8b3db68 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.464195 Jul 21 22:26:21.303511 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:21.316623 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9568d85c-00b7-46d8-9653-22850624be5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:21.345369 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9568d85c-00b7-46d8-9653-22850624be5d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033196 Jul 21 22:26:21.346144 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 22:26:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:23.631964 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-ce5fdc00-251d-4eb6-9959-e1aaf8b3db68 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:23.633659 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-ce5fdc00-251d-4eb6-9959-e1aaf8b3db68 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jul 21 22:26:23.634480 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:24.198942 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ef73ef49-dd41-41f3-ab70-f62c0e2cd763 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "vcpus": 4}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:24.204886 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:24.222487 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ef73ef49-dd41-41f3-ab70-f62c0e2cd763 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.582181 Jul 21 22:26:24.223377 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:24.235299 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-7f01ab4d-0633-4e24-98e0-da082fee4dd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:24.265460 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-7f01ab4d-0633-4e24-98e0-da082fee4dd6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033679 Jul 21 22:26:24.266093 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 22:26:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:26.599845 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ef73ef49-dd41-41f3-ab70-f62c0e2cd763 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:26.600866 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ef73ef49-dd41-41f3-ab70-f62c0e2cd763 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 21 22:26:26.606501 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:27.066362 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "ram": 16384}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:27.084985 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.477245 Jul 21 22:26:27.085845 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1282 bytes} [Thu Jul 21 22:26:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:26:27.097814 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-832f69d8-2383-4283-a396-2d21c6de90df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:27.125294 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-832f69d8-2383-4283-a396-2d21c6de90df admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031034 Jul 21 22:26:27.126235 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1332 bytes} [Thu Jul 21 22:26:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:46.927362 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:46.928417 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 21 22:26:46.929459 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:26:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:46.940095 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:47.346764 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-80a53fa7-61e7-4738-9b03-b5bde90cc0bd admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:47.364533 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-80a53fa7-61e7-4738-9b03-b5bde90cc0bd admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428719 Jul 21 22:26:47.365006 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 22:26:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:48.466844 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:48.467868 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d56d70bb-bf00-45e8-832f-16d4d3bcbdf2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 21 22:26:48.468271 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:49.017757 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-486cefc4-7775-492d-a3dd-649ff76c731f admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:49.024324 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-486cefc4-7775-492d-a3dd-649ff76c731f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-486cefc4-7775-492d-a3dd-649ff76c731f admin admin] Request method failure captured: Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.42 Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi2dKoQcfY3f9dmTyHJfOTYzMLSQSGH2hISUNzSXJKBMZJeNhhnX1-TWgILsQlYXk15zBIyk1rCLjjxG0PbgeEMbep6ZJi_ZN6C3HNAkoP4INl92HHb_bqESdUJMWHZtqAhZ-QWaPWyru2gNTiEQVSsgnXGRSOOtVKbLMEgZqZwvYnMiA Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Role: reader,member,admin Jul 21 22:26:49.030636 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Roles: reader,member,admin Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User: admin Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: method: > Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: exception: Flavor 42 could not be found. Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '42'} Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:49.032386 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:49.033474 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.034962 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-486cefc4-7775-492d-a3dd-649ff76c731f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:49.036299 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-486cefc4-7775-492d-a3dd-649ff76c731f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421178 Jul 21 22:26:49.036299 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:49.042884 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-28db3b66-6763-4412-82b9-afd9dd3f61f4 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:49.045998 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:49.067219 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-28db3b66-6763-4412-82b9-afd9dd3f61f4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028602 Jul 21 22:26:49.067808 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:49.078451 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5bef03e6-42c8-40ab-8082-f29035733b5b admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:49.100302 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5bef03e6-42c8-40ab-8082-f29035733b5b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025584 Jul 21 22:26:49.101598 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:49.111210 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-e929c7b7-a273-4049-8610-257dfc2182fb admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:49.117603 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-e929c7b7-a273-4049-8610-257dfc2182fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-e929c7b7-a273-4049-8610-257dfc2182fb admin admin] Request method failure captured: Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept: application/json Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Connection: keep-alive Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Content-Length: 0 Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Host: 10.222.0.42 Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi2dKoQcfY3f9dmTyHJfOTYzMLSQSGH2hISUNzSXJKBMZJeNhhnX1-TWgILsQlYXk15zBIyk1rCLjjxG0PbgeEMbep6ZJi_ZN6C3HNAkoP4INl92HHb_bqESdUJMWHZtqAhZ-QWaPWyru2gNTiEQVSsgnXGRSOOtVKbLMEgZqZwvYnMiA Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Role: reader,member,admin Jul 21 22:26:49.120954 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Roles: reader,member,admin Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant: admin Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User: admin Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Name: admin Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: method: > Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: exception: Flavor 42 could not be found. Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: action_args: {'id': '42'} Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:49.122452 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:49.123272 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:49.124351 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-e929c7b7-a273-4049-8610-257dfc2182fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:49.125391 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-e929c7b7-a273-4049-8610-257dfc2182fb admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014751 Jul 21 22:26:49.125391 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:50.110395 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5bef03e6-42c8-40ab-8082-f29035733b5b admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:50.111422 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5bef03e6-42c8-40ab-8082-f29035733b5b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 21 22:26:50.111808 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:26:50.655249 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-278b452d-11b4-40e3-92e9-e5fa741c90ef admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:50.660760 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-278b452d-11b4-40e3-92e9-e5fa741c90ef admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-278b452d-11b4-40e3-92e9-e5fa741c90ef admin admin] Request method failure captured: Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept: application/json Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Connection: keep-alive Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Content-Length: 0 Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Host: 10.222.0.42 Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi2dKqORClcldXpMsH3eokzrXHzW2bYs0VWvqIfen28kJKWlf4bJOSU26S62-cm5jlzuV9k0i1rv-1bLFpjZVwwx-iWcwRrAr7g5sWUqyuaJNyCFdZMnMIpGqqsrdnNGTtRaPeX84TagzsYkDpIXapBI9jh_3B84TA7Mzwmg4wNoXgPYY Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Role: reader,member,admin Jul 21 22:26:50.662315 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Roles: reader,member,admin Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant: admin Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User: admin Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Name: admin Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: method: > Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: exception: Flavor 84 could not be found. Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: action_args: {'id': '84'} Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:50.665173 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:50.666244 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.667629 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-278b452d-11b4-40e3-92e9-e5fa741c90ef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:50.668982 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-278b452d-11b4-40e3-92e9-e5fa741c90ef admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.412455 Jul 21 22:26:50.668982 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:50.674874 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-ace7074d-44e7-408d-840d-71eb1a218d6a admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:50.690757 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-ace7074d-44e7-408d-840d-71eb1a218d6a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019580 Jul 21 22:26:50.691398 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:50.701755 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-258c0c68-921a-4ee4-842f-a8688683d4d2 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:50.716847 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-258c0c68-921a-4ee4-842f-a8688683d4d2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018599 Jul 21 22:26:50.717505 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:50.728125 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1fbc9c9d-91d0-420f-bd9d-8dc895017b12 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:50.733984 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-1fbc9c9d-91d0-420f-bd9d-8dc895017b12 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1fbc9c9d-91d0-420f-bd9d-8dc895017b12 admin admin] Request method failure captured: Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.42 Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi2dKqORClcldXpMsH3eokzrXHzW2bYs0VWvqIfen28kJKWlf4bJOSU26S62-cm5jlzuV9k0i1rv-1bLFpjZVwwx-iWcwRrAr7g5sWUqyuaJNyCFdZMnMIpGqqsrdnNGTtRaPeX84TagzsYkDpIXapBI9jh_3B84TA7Mzwmg4wNoXgPYY Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Role: reader,member,admin Jul 21 22:26:50.735564 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Roles: reader,member,admin Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User: admin Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: method: > Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: exception: Flavor 84 could not be found. Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '84'} Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:50.737050 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:50.737862 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:50.739352 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-1fbc9c9d-91d0-420f-bd9d-8dc895017b12 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:50.740632 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-1fbc9c9d-91d0-420f-bd9d-8dc895017b12 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013272 Jul 21 22:26:50.740632 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Jul 21 22:26:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:51.732271 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-258c0c68-921a-4ee4-842f-a8688683d4d2 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:51.733326 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-258c0c68-921a-4ee4-842f-a8688683d4d2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 21 22:26:51.733727 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:52.283726 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5693ce1e-be30-4dd8-9057-41a5c09c3be7 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:52.290557 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.wsgi [None req-5693ce1e-be30-4dd8-9057-41a5c09c3be7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5693ce1e-be30-4dd8-9057-41a5c09c3be7 admin admin] Request method failure captured: Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept: application/json Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Accept-Encoding: gzip, deflate Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Connection: keep-alive Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Content-Length: 0 Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Host: 10.222.0.42 Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Openstack-System-Scope: None Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: User-Agent: python-novaclient Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Auth-Token: gAAAAABi2dKr5CRj-WXeT4ypyh-7KuZQN2UqcilAL_7PMB1vPUHDBATTyfzETunDMjsdBTEeK4Gp5GV9xzc-_BSYOp8Ikgh1Akhb3vJizuh0eyiqr8Ou56EYS03Yci1_XNCuoiaxf1zCmqR72IHtpw0fiNkw9n1kxgkbyVtEkbgYImdkOEiGKxE Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Id: None Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Domain-Name: None Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Identity-Status: Confirmed Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Is-Admin-Project: True Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Id: default Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Domain-Name: Default Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Project-Name: admin Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Role: reader,member,admin Jul 21 22:26:52.292075 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Roles: reader,member,admin Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant: admin Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-Tenant-Name: admin Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User: admin Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Id: default Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Domain-Name: Default Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: X-User-Name: admin Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: method: > Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: exception: Flavor 451 could not be found. Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: action_args: {'id': '451'} Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:52.293649 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:52.294806 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.296310 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-5693ce1e-be30-4dd8-9057-41a5c09c3be7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103343) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:52.297745 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-5693ce1e-be30-4dd8-9057-41a5c09c3be7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.420154 Jul 21 22:26:52.297745 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:26:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 22:26:52.303459 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-961c8b99-843b-4ed4-b27e-dba2ec49d911 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:52.318546 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-961c8b99-843b-4ed4-b27e-dba2ec49d911 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018687 Jul 21 22:26:52.319128 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:26:52.329045 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:52.343237 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jul 21 22:26:52.343789 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Jul 21 22:26:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:26:52.353929 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-4d90dc93-ec72-40a9-8e6a-d0dd96ac4ac6 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:52.359527 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.wsgi [None req-4d90dc93-ec72-40a9-8e6a-d0dd96ac4ac6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-4d90dc93-ec72-40a9-8e6a-d0dd96ac4ac6 admin admin] Request method failure captured: Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept: application/json Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Accept-Encoding: gzip, deflate Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Connection: keep-alive Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Content-Length: 0 Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Host: 10.222.0.42 Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-Api-Version: compute 2.90 Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Openstack-System-Scope: None Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: User-Agent: python-novaclient Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Auth-Token: gAAAAABi2dKr5CRj-WXeT4ypyh-7KuZQN2UqcilAL_7PMB1vPUHDBATTyfzETunDMjsdBTEeK4Gp5GV9xzc-_BSYOp8Ikgh1Akhb3vJizuh0eyiqr8Ou56EYS03Yci1_XNCuoiaxf1zCmqR72IHtpw0fiNkw9n1kxgkbyVtEkbgYImdkOEiGKxE Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Id: None Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Domain-Name: None Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Identity-Status: Confirmed Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Is-Admin-Project: True Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Id: default Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Domain-Name: Default Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Project-Name: admin Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Role: reader,member,admin Jul 21 22:26:52.361107 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Roles: reader,member,admin Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5705979642f541aa9229c56505a6ee6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5705979642f541aa9229c56505a6ee6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant: admin Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Id: 5705979642f541aa9229c56505a6ee6e Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-Tenant-Name: admin Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User: admin Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Id: default Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Domain-Name: Default Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Id: e2841614037940fea030f1d6c1eca499 Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: X-User-Name: admin Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: method: > Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: exception: Flavor 451 could not be found. Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: action_args: {'id': '451'} Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:26:52.362713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:52.363676 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: ERROR nova.api.openstack.wsgi Jul 21 22:26:52.365285 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-4d90dc93-ec72-40a9-8e6a-d0dd96ac4ac6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103344) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:26:52.366831 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-4d90dc93-ec72-40a9-8e6a-d0dd96ac4ac6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012762 Jul 21 22:26:52.366831 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:26:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 22:26:53.402146 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:53.403175 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 21 22:26:53.403603 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:53.950115 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-2f3fbdf8-5236-447c-8154-52e8dfc94358 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:53.968235 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-2f3fbdf8-5236-447c-8154-52e8dfc94358 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.423466 Jul 21 22:26:53.968809 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:54.972510 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:54.973711 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 21 22:26:54.974121 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:55.515279 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-1259fdda-7b2b-454c-9f14-2c704a78f387 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:55.533431 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-1259fdda-7b2b-454c-9f14-2c704a78f387 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.421457 Jul 21 22:26:55.534006 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:56.523129 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:56.524234 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 Jul 21 22:26:56.524673 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:57.065345 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-ab314ea5-3fde-46b5-90d9-35ab3424598a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:57.083802 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-ab314ea5-3fde-46b5-90d9-35ab3424598a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.421069 Jul 21 22:26:57.084353 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:58.073661 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:58.074729 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001952 Jul 21 22:26:58.075136 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:58.610284 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d8c2f27f-86d2-4957-9fe1-3f6066def0f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:58.629788 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d8c2f27f-86d2-4957-9fe1-3f6066def0f0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413630 Jul 21 22:26:58.630448 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Jul 21 22:26:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:26:59.626059 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:59.627068 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 21 22:26:59.627468 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:27:00.156799 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-213ff653-2fcb-4bad-be58-b1c64bb98e84 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:00.176053 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-213ff653-2fcb-4bad-be58-b1c64bb98e84 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412526 Jul 21 22:27:00.176606 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Jul 21 22:26:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:27:53.314201 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.315254 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-78fcb859-46c4-486c-be73-f9340fd4ba58 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jul 21 22:27:53.315664 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 930 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:27:53.326982 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:53.734365 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-d9a59c43-22e0-4e03-897a-3081d7f16525 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.754268 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-d9a59c43-22e0-4e03-897a-3081d7f16525 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.431749 Jul 21 22:27:53.754805 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1291 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:27:53.775879 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG dbcounter [-] [103343] Writing DB stats nova_api:SELECT=14 {{(pid=103343) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:53.785876 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-eff06231-a4fe-49bb-a5fd-352a0d6906b8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.794932 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-eff06231-a4fe-49bb-a5fd-352a0d6906b8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020405 Jul 21 22:27:53.795489 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:27:53.809147 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-981a48aa-9613-4eed-99fc-d0f93a39ff92 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.817051 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-981a48aa-9613-4eed-99fc-d0f93a39ff92 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011883 Jul 21 22:27:53.817577 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:27:53.829490 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.837503 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011808 Jul 21 22:27:53.838022 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1285 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:27:53.850335 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-fd0b77f5-aa98-4d67-8f41-109407d72191 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:27:53.858356 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-fd0b77f5-aa98-4d67-8f41-109407d72191 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012274 Jul 21 22:27:53.858886 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1282 bytes} [Thu Jul 21 22:27:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:31:34.860844 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:34.861861 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 21 22:31:34.862260 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:31:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:35.002699 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=6 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:35.163441 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:35.164643 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:31:35.164643 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:31:35.165851 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:35.166290 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:35.167229 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:35.167509 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:35.201709 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-77ce60a2-8826-44d1-ba89-fcdac81af593 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200442 Jul 21 22:31:35.202268 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:31:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:31:36.042055 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:36.043077 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 21 22:31:36.043471 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:36.241115 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:36.242357 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:31:36.242357 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:31:36.243548 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:36.244045 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:36.244865 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:36.245294 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:36.265667 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-24d4d13f-a406-4859-b1e0-c4f601715136 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079895 Jul 21 22:31:36.266156 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:31:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:31:47.546698 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:47.547744 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 21 22:31:47.548171 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:31:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:47.696311 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell0:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:47.698014 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_cell1:SELECT=4 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:47.699297 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG dbcounter [-] [103344] Writing DB stats nova_api:SELECT=8 {{(pid=103344) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:47.749511 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:47.750704 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:31:47.750704 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:31:47.751915 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:47.752441 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:47.753348 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:47.753785 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:47.782580 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-f8965c85-b311-4b63-80c6-82d3eddcc59a admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091114 Jul 21 22:31:47.783177 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:31:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:31:48.650217 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: DEBUG nova.api.openstack.wsgi [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] Calling method '>' {{(pid=103343) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:48.651319 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: INFO nova.api.openstack.requestlog [None req-9fe73e10-b670-43a6-a2ff-443f967c62c8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 21 22:31:48.651719 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: [pid: 103343|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Jul 21 22:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:48.849825 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG nova.api.openstack.wsgi [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] Calling method '>' {{(pid=103344) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:48.851611 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 22:31:48.851611 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: warnings.warn(msg) Jul 21 22:31:48.852888 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:48.853338 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:48.854143 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:48.854581 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: DEBUG oslo_concurrency.lockutils [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103344) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:48.876713 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: INFO nova.api.openstack.requestlog [None req-0fa8688e-8ba5-42e3-8d7a-4a368a7eb6ed admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082146 Jul 21 22:31:48.877211 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: [pid: 103344|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Jul 21 22:31:48 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:32:47.674506 dv-cinder-850696-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 22:32:47.675449 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: Thu Jul 21 22:32:47 2022 - graceful shutdown triggered... Jul 21 22:32:47.675898 dv-cinder-850696-1-iscsi devstack@n-api.service[103343]: Gracefully killing worker 1 (pid: 103343)... Jul 21 22:32:47.676364 dv-cinder-850696-1-iscsi devstack@n-api.service[103344]: Gracefully killing worker 2 (pid: 103344)... Jul 21 22:32:48.675545 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: worker 1 buried after 1 seconds Jul 21 22:32:48.676309 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: worker 2 buried after 1 seconds Jul 21 22:32:48.676309 dv-cinder-850696-1-iscsi devstack@n-api.service[103342]: goodbye to uWSGI. Jul 21 22:32:48.677625 dv-cinder-850696-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 22:32:48.678174 dv-cinder-850696-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 22:32:48.681064 dv-cinder-850696-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 22:32:48.695048 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 22:32:48 2022] *** Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: nodename: dv-cinder-850696-1-iscsi Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: machine: x86_64 Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: clock source: unix Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: pcre jit disabled Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: detected number of CPU cores: 4 Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: current working directory: / Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: detected binary path: /usr/bin/uwsgi-core Jul 21 22:32:48.698149 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: your processes number limit is 47680 Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: your memory page size is 4096 bytes Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: detected max file descriptor number: 2048 Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: lock engine: pthread robust mutexes Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: thunder lock: enabled Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 22:32:48.699452 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 22:32:48.748969 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: Python main interpreter initialized at 0x5580f1afe9c0 Jul 21 22:32:48.748969 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: python threads support enabled Jul 21 22:32:48.748969 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: your server socket listen backlog is limited to 100 connections Jul 21 22:32:48.748969 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: your mercy for graceful operations on workers is 90 seconds Jul 21 22:32:48.749722 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 22:32:48.749722 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: *** Operational MODE: preforking *** Jul 21 22:32:48.749722 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: *** uWSGI is running in multiple interpreter mode *** Jul 21 22:32:48.749722 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: spawned uWSGI master process (pid: 124519) Jul 21 22:32:48.750017 dv-cinder-850696-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 22:32:48.750599 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: spawned uWSGI worker 1 (pid: 124534, cores: 1) Jul 21 22:32:48.750916 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: spawned uWSGI worker 2 (pid: 124535, cores: 1) Jul 21 22:32:48.751071 dv-cinder-850696-1-iscsi devstack@n-api.service[124519]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 22:32:49.480001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:32:50.039446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 22:32:50.826425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:32:50.826425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: from cryptography.utils import int_from_bytes Jul 21 22:32:50.827457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:32:50.827457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: from cryptography.utils import int_from_bytes Jul 21 22:32:51.815961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:32:51.815961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: from cryptography.utils import int_from_bytes Jul 21 22:32:51.816947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 22:32:51.816947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: from cryptography.utils import int_from_bytes Jul 21 22:32:53.468954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:32:53.469795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:32:53.469795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:32:53.470219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:32:53.471098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:32:53.471608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.472088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.472415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.472807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.473152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.473461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.473789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.474128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.474445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.474763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.475034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.475362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850696-1-iscsi {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.475687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.475997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.476310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.476667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.476981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.477347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.477652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.478159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.479946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.480275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.480636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.481004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.481334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.481651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.482175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.482669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.483017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.483335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.483779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850696-1-iscsi {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.484069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.484572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.485077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.485515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.486540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.487094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.487629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.488137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.488657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.489153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.489682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.490165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.490649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.491123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.491582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.492067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.492596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.493079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.493570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.493989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.494470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.494972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.495456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.495953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.496377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.496827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.497314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.497817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.498298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.498766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.499248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.499722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.500201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.500704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.501188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.502281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.503079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.503572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.504086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.504582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.505085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.505675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.506100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.506600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.507122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.507612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.508096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.508617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.509124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.509594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.510082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.510809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.511292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.511786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.512248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.512701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.513188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.513654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.514133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.514598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.515070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.515542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.516018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.516511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.517021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.517721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.518350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.518833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.519323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.519802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.520280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.520801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.521307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.521808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.522286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.523445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.523445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.523731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.523933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.524415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.524861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.525103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.525575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.526057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.526540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.527020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.527498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.527991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.528464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.528974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.529456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.529938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.530417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.530882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.531358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.531820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.532284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.533432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.534120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.534597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.535103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.535608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.536097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.536612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.537096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.537585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:53.538087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.538619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.538986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.539321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.539671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.540033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.540345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.540702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.541029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.541376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.541694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.542014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.542338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.542663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.542994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.543333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.543656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.543981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.544303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.544662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.544988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.545327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.545658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.545978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.546329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.546681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.547004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.547339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.547671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.547991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.549386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.549386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.550071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.550528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.550871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.551285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.551558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.551937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.552219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.552437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.552789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.553140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.553465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.553770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.554093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.554414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.554730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.555064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.555457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.555687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.556001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.556250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.556614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.556927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.557253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.557637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.557900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.558241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.558552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.558868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.559182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.559497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.559808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.560126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.560439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.560777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.561111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.561527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.561754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.562140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.562385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.562674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.563004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.563321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.563639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.565031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.565639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.565909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.566332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.566574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.566867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.567207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.567522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.567920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.568183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.568537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.568858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.569177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.569490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.569804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.570118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.570434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.570922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.571162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.571393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.571632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.571992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.572371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.572682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.572897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.573210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.573568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.573877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.574188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.574548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.574902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.575339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.575576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.575962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.576190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.576768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.577017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.577245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.577466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.577768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.578178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.578422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.578867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.579098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.579940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.580357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.580999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.581313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.581673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.582072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.582343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.582678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.582997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.583322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.583639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.583958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.584276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.584620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.584956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.585272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.585595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.585915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.586298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.586527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.586932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.587158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.587462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.587799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.588139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.588584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.588919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.589211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.589429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.589705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.590022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.590333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.590643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.590956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.591278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.591592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.591905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.592298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.592573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.592923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.593147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.593462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.593765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.594099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.594413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.594746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.595665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.596126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.596701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.597101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.597339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.597656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.597968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.598277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.598657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.598941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.599252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.599576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.599902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.600218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.600568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.600883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.601216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.601673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.601917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.602154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.602568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.602828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.603068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.603371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.603714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.604027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.604339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.605628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.605628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.605628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.605628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.606508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.606508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.607086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.607086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.607672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.607888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.608185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.609206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.609206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.609206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.609924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.610161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.610417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.611259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.611641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.612200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.612943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.613211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.613450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.613700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.613925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.614212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.614533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.614850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.615170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.615480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.615815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.616131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.616439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.616779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.617213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.617480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.617913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.618161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.618412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.619168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.619168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.619679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.619679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.620110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.620378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.620676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.620916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.621199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.621507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.621825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.622118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.622437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.622750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.623164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.623402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.623661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.623981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.624294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.624634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.624943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.625257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.625567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.625873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.626186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.627407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.627647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.628080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.628405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.628749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.629444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.629444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.629905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.630133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.630359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.630596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.630903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.631395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.631704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.631932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.632161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.632920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.632920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.633209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.633443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.633744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.633998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.634310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.634630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.634936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.635263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.635802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.636110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.636415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.636802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.637100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.637408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.637714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.638020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.638374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.638680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.639062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.639513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.639680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.640007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.640327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.640688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.641086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.641284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.641590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.642414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.642781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.643329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.643802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.644150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.644527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.644824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.645158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.645491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.645826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.646138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.646457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.646773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.647088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.647403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.647719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.648033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.648348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.648696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.649014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.649328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.649639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.649958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.650359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.650600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.651021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.651221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.651532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.651840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.652140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.652467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.652801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.653270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.653588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.653900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.654217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.654540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.654856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.655178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.655497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.655808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.656247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.656601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.656932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.657241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.658583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.658583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.659150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.659660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.659984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.660209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.660525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.660863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.661365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.661598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.661943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.662272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.662584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.663043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.663303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.663620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.663620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.664431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.664739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.664998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.665319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.665645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.665975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.666586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.666844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.666999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.667267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.667569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.667897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.668215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.668569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.669011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.669340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.669654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.669986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.670315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.670624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.670930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.671246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.671552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.671861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.672190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.672529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.672835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.673175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.673517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.674072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.674550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.674972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.675200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.675534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.675862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.676190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.676619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.676882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.677194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.677509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.677818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.678126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.678426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.678777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.679090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.679419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.679761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.680098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.680417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.680791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.681129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.681457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.681782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.682115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.682430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.682740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.683058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.683369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.683680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.683990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.684329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.684655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.685096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.685335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.685608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.685919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.686247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.686591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.686881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.687176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.687472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.687850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.688195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.688816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.689351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.690692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.690692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.690692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.691400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.691400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.691847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.691847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.692308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.692608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.692852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.693095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.693392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.693713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.694095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.694364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.694988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.695289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.695614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.695936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.696411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.696906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.697232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.697568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.697941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.698195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.698483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.698826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.699158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.699495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.699859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.700186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.700543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.701019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.701331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.701560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.701841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.702515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.702515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.702967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.703210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.703484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.703727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.703986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.704321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.705242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.705760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.706275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.706837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.707364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.707817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.708157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.708649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.709059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.709367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.709961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.710287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.710668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.710983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.711296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.711622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.711974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.712307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.712675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.713057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.713290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.713591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.713901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.714229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.714543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.714854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.715410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.715909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.716731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.717164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.717668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.718112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.718451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.718789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.719200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.719538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.719856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.720991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.721443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.721804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.722144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.722461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.722786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.723106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.723417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.723751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.724064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.724404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.724822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.725136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.725581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.725830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.726075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.726359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.726671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.727067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.727307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.727582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.727897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.728204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.728631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.728879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.729129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.729491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.729828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.730138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.730449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.730775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.731088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.731418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.731736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.732049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.732406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.732759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.733362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.733701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.734026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.734371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.734706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.735018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.735335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.735828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.736124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.736605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.737144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.737414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.737725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.738045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.738358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.738676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.738990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.739307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.739619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.739923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.740232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.740573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.740896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.741416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.741906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.741906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.742418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.742671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.742934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.743179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.743412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.743700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.744018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.744360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.744712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.745004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.745459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.745773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.746189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.746441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.746691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.747030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.747469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.747718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.747965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.748265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.748627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.748978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.749310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.749642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.749953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.750263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.750644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.750903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.751182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.752433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.752776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.753122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.753438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.753746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.754058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.754370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.754695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.754953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.755266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.755570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.755857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.756268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.756587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.756833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.757104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.757522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.757778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.758021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.758298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.758606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.758955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.759293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.759612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.759941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.760254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.760843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.761164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.761495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.761821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.762311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.762578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.762827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.763097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.763391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.763706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.764024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.764341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.764689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.765032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.765364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.765678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.766018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.766445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.766715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.767621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.768028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.768618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.768921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.769246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.769566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.769886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.770204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.770527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.770844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.771160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.771485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.771808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.772149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.772661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.772938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.773207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.773459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.773814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.774133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.774487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.774819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.775137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.775457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.775768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:53.776029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:32:53.939341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO dbcounter [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Registered counter for database nova_api Jul 21 22:32:53.961948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_db.sqlalchemy.engines [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:53.975635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writer thread running {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:54.047432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.context [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4803857f-df2d-488f-a38b-a8f790f3829e(cell1) {{(pid=124535) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:32:54.053013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:54.054701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:54.055556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:54.057658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:54.059752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO dbcounter [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Registered counter for database nova_cell0 Jul 21 22:32:54.064659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO dbcounter [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Registered counter for database nova_cell1 Jul 21 22:32:54.074877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_db.sqlalchemy.engines [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:54.076040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_db.sqlalchemy.engines [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:54.085539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writer thread running {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:54.085888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writer thread running {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:54.250986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO dbcounter [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Registered counter for database nova_cell0 Jul 21 22:32:54.261607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_db.sqlalchemy.engines [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:54.270408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writer thread running {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:54.930912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: WARNING keystonemiddleware.auth_token [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:54.946328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: WARNING keystonemiddleware.auth_token [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:55.042621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 22:32:55.043380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 22:32:55.043529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 22:32:55.044019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 22:32:55.044172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 22:32:55.044449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.044816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.045141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.045468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.045811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.046581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.046581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.046870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.047077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.047344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.047664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.047994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850696-1-iscsi {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.049723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.049723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.050134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.050498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.050644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.050965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.051233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.051755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.052136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.052383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.052733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.053086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.053402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.053718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.054038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.054356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.054687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.055110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850696-1-iscsi {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.059642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.061713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.063554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.064742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.064742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.064742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.065289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.065627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.065949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.066267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.066612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.066926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.067238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.067553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.067865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.068178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.068579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.068918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.069242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.069559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.069911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.070324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.071174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.071507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.071859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.072281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.072995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.073399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.073687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.073990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.074305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.074634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.074989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.075312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.075618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.075877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.076191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.076573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.077365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.077365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.077554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.077755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.078245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.078560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.078876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.079206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.079738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.080154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.080471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.080806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.081122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.081435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.081772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.082102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.082419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.082729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.083038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.083346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.083674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.084328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.084328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.084684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.085002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.085313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.085638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.085947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.086318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.086579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.086914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.087230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.087557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.089848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.090417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.090417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.090760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.090931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.091364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.091793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.092018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.092363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 22:32:55.092773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.093135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.096089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.097439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.097439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.097439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.097439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.098004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.098004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.098302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.098654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.099242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.099419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.099663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.100113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.100335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.100672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.101024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.101383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.101703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.102059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.102785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.102785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.103114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.103372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.104032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.104032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.104350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.104685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.105049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.105370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.105706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.106032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.107919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.108235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.108769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.108961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.109625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.109625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.109936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.110098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.110500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.111804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.112167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.112591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.112891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.113210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.113538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.113861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.114180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.114498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.114821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.115325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.115869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.116213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.116614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.116877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.117210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.117531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.117835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.118161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.118477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.119449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.119449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.119449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.119853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.120049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.120367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.120747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.121090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.121403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.124368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.125734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.126076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.127093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.127413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.127732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.128043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.128401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.129288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.129653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.130035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.130335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.130765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.130991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.131637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.131637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.131946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.132268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.132618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.132954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.133273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.133611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.133933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.134274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.134595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.134926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.135244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.135836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.136193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.136962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.136962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.137214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.137535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.137863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.138184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.138506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.138827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.139154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.139483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.139801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.140127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.140451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.141302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.141625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.141993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.142316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.142670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.143303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.143303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.143643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.143967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.144298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.144650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.144973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.145295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.145609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.145922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.146323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.146561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.146879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.147201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.147516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.147836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.148155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.148469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.148807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.149130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.149468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.149868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.150112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.150443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.151535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.151535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.151865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.152061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.152850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.153324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.153653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.154017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.154660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.154825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.155081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.155419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.155741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.156071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.156467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.157247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.157247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.157830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.158007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.158271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.158588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.158904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.159223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.159560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.159880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.160196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.161074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.161410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.161832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.162052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.162649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.163160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.163323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.163672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.163932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.164258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.164627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.164965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.165314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.165631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.165950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.166351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.166644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.166884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.167198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.167511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.167823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.168139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.168458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.168824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.169127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.169908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.169908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.170234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.170386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.170653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.170991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.171309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.172301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.172301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.172301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.172683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.172902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.173815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.174274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.174569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.174891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.175287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.175644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.176005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.176366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.176724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.177104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.177583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.177822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.178173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.178502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.178899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.179191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.179549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.179854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.180184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.181035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.181382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.182344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.182344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.182344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.182676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.183133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.183319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.184124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.184462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.184805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.185122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.185438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.185761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.186082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.186404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.187785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.188113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.188438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.189427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.189760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.190101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.190502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.190713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.191084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.191408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.192558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.192789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.193701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.193701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.193701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.194196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.194354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.194932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.194932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.195242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.195539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.195879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.196199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.197279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.197279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.197578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.197871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.198187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.198561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.199186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.199186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.199514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.199836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.200162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.200521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.200846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.201176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.201498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.201822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.202674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.202674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.202854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.203102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.203420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.203772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.204129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.205032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.205353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.205676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.205996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.206308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.206628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.206947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.207264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.207584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.207911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.208220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.208565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.208883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.209204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.209521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.209842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.210180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.210498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.212634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.213227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.213227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.213429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.213774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.214099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.214978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.214978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.215179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.215507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.215845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.216166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.216505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.216847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.217159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.217477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.217814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.218126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.218441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.218828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.219113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.219427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.219753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.220803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.221139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.221452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.221885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.222205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.222522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.222855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.223505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.223505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.223831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.224129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.224443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.225339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.225678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.226001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.226326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.226640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.226971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.227303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.227626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.228233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.228383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.228911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.229237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.229572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.229907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.230221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.230542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.230859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.231174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.231487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.231819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.232130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.232450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.235260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.236224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.236224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.236703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.236703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.236967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.237270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.237787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.238124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.238457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.238833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.239152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.239483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.239823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.240163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.240968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.240968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.241163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.241483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.241810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.242143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.242503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.242810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.243101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.243453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.243789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.244118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.244434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.244940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.245262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.245584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.245923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.246245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.246572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.246890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.247198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.247512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.247822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.248176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.248504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.249383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.249722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.250041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.250380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.250697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.251031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.251932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.252256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.252626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.253033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.253269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.253595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.253916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.254242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.254576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.254888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.255211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.255799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.256383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.256557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.256802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.257107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.257425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.258008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.258142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.258359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.258676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.259003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.259340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.259669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.260003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.260351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.262713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.263068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.263412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.263750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.264148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.264525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.264842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.265180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.265516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.265848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.266177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.266501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.267548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.268826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.268826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.268826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.268826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.269745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.269745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.269745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.270412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.270412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.270834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.271071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.271518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.271851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.272330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.272689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.272966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.273235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.273568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.273908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.274233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.274549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.274872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.275191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.275505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.275840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.276158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.276503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.276830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.277147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.278169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.278169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.278692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.278922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.279145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.279391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.279714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.280045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.280360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.280701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.281034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.281364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.281675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.282366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.282366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.282689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.282939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.283441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.284022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.284601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.285081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.285584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.286060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.286552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.286870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.287191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.288368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.288368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.288368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.289106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.289106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.289106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.289764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.289764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.290184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.290420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.290698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.291021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.291330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.291663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.291983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.292318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.292689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.293013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.293385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.293705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.294319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.294851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.295178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.295529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.295871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.296189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.296547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.297045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.297556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.298124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.298874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.299400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.299902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.300431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.300997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.301534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.302049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.302571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.303113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.303430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.304262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.304262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.304818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.304818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.305271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.305494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.305724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.306033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.306354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.306674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.306992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.307306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.307630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.307983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.308309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.308678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.309128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.309452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.309781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.310116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.310449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.310772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.311103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.311444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.311748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.312245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.312783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.313342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.314385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.315508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.315508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.315508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.316042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.316042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.316414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.316677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.316925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.317245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.317587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.317874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.318478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.318478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.318864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.319102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.319413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.319726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.320036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.320346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.320693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.321009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.321328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.321637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.322843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.322843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.322843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.322843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.323741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.323741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.324193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.324193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.324676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.324910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.325122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.325451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.325997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.326546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.326863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.327214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.327535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.327857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.328176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.328555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.328845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.329168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.330082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.330445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.330703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.331051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.331372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.331709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.332033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.332353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.332762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.333442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.333442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.333889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.334153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.334375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.334602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.334914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.335228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.335750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.336672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.336672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.336672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.336929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.337207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.337643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.337898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.338966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.338966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.338966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.340536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.340536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.340536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 22:32:55.340536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 22:32:55.454009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: WARNING keystonemiddleware.auth_token [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:55.461465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: WARNING keystonemiddleware.auth_token [None req-58b7d31e-9c47-4943-98e8-f044f6efaa62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:55.469182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5580f1afe9c0 pid: 124535 (default app) Jul 21 22:32:55.519546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO dbcounter [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Registered counter for database nova_api Jul 21 22:32:55.542733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:55.551119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writer thread running {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:55.614398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.context [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4803857f-df2d-488f-a38b-a8f790f3829e(cell1) {{(pid=124534) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 22:32:55.618844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:55.620557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:55.621417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:55.623531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:55.625660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO dbcounter [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Registered counter for database nova_cell0 Jul 21 22:32:55.632420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO dbcounter [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Registered counter for database nova_cell1 Jul 21 22:32:55.641161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:55.643375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:55.650957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writer thread running {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:55.653060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writer thread running {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:55.808723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO dbcounter [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Registered counter for database nova_cell0 Jul 21 22:32:55.817787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_db.sqlalchemy.engines [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 22:32:55.823532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writer thread running {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 22:32:56.164450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: WARNING keystonemiddleware.auth_token [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:56.175159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: WARNING keystonemiddleware.auth_token [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:56.550851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: WARNING keystonemiddleware.auth_token [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 22:32:56.559596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: WARNING keystonemiddleware.auth_token [None req-9fb93c8e-9196-48ec-afdc-00ff2e7a38b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 22:32:56.568450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5580f1afe9c0 pid: 124534 (default app) Jul 21 22:33:44.011795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:44.016022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:44.017493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:44.020435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:46.637381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3b01e791-e787-4f28-8079-b733af545f70 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Action: 'create', calling method: .version_select at 0x7ff1daa0dca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-127466407", "metadata": {"Type": "work"}}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:48.512976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:48.522454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:48.529383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:48.537931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:49.457466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee1cc227-026f-4c90-8e87-d6ae9b4dd463 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da9a0820>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:50.135001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3b01e791-e787-4f28-8079-b733af545f70 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 6.140030 Jul 21 22:33:50.136094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 22:33:43 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 6143 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 21 22:33:50.153387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fd27c11b-0917-4b46-9715-102c9915550a tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da869af0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:50.210532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee1cc227-026f-4c90-8e87-d6ae9b4dd463 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/a99d5987-3a60-4e47-8b55-b758ba4b3f1e" status: 200 len: 350 microversion: 2.1 time: 1.715950 Jul 21 22:33:50.211592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:48 2022] GET /compute/v2.1/os-volumes/a99d5987-3a60-4e47-8b55-b758ba4b3f1e => generated 350 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:50.366432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fd27c11b-0917-4b46-9715-102c9915550a tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 352 microversion: 2.1 time: 0.220069 Jul 21 22:33:50.368701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:50 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 352 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:51.383536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-48bc9e55-cd4a-439d-ad27-83ed7a147325 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da862a60>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.519812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-48bc9e55-cd4a-439d-ad27-83ed7a147325 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 353 microversion: 2.1 time: 0.141927 Jul 21 22:33:51.520407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:51 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:51.535171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2ae5b9b9-4642-4003-8436-fac554812474 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da869c10>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.630223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2ae5b9b9-4642-4003-8436-fac554812474 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 353 microversion: 2.1 time: 0.102230 Jul 21 22:33:51.631382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:51 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:51.649861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5daadc59-d990-4287-9ce0-6ce1508605a6 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da8231f0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.830601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5daadc59-d990-4287-9ce0-6ce1508605a6 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 202 len: 0 microversion: 2.1 time: 0.184999 Jul 21 22:33:51.832155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 22:33:51 2022] DELETE /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:33:51.844831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2ef854c6-2171-4e1b-bddc-5ede60b2fd11 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da87f310>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.932342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2ef854c6-2171-4e1b-bddc-5ede60b2fd11 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 352 microversion: 2.1 time: 0.094336 Jul 21 22:33:51.933304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:51 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:52.518205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-45cf2f72-388f-445a-888a-3cd200764598 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da8238b0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:52.616762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-45cf2f72-388f-445a-888a-3cd200764598 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/900b4717-ddb1-4274-bacb-260b6432df5d" status: 200 len: 351 microversion: 2.1 time: 0.103238 Jul 21 22:33:52.626571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/os-volumes/900b4717-ddb1-4274-bacb-260b6432df5d => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:52.953815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7bf42653-401a-4304-bf66-febe4901a544 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da87f9d0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:53.069952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7bf42653-401a-4304-bf66-febe4901a544 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 352 microversion: 2.1 time: 0.126419 Jul 21 22:33:53.071385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:54.086583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-85dfdb39-cf22-48ab-b2c5-a9f59b0a7294 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da862ca0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:54.254635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-85dfdb39-cf22-48ab-b2c5-a9f59b0a7294 tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 352 microversion: 2.1 time: 0.174495 Jul 21 22:33:54.255419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:54 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:55.309723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32cf3fbc-a421-46c6-9c21-1de89de9a29e tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1da87faf0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:55.536180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32cf3fbc-a421-46c6-9c21-1de89de9a29e tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 200 len: 352 microversion: 2.1 time: 0.269310 Jul 21 22:33:55.537127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:55 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 352 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:56.235129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac977c3e-1e03-4f66-945f-814d02a2a1bd tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da87f430>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:56.250015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89ba743c-1d12-4f13-b3b1-98929eddd030 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'create', calling method: .version_select at 0x7ff1da823c10>, body: {"keypair": {"name": "tempest-keypair-1080856489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2bJxrHg/0dESlm6+DzSL5L09tAavaH7f1x91BuHbbO26KWnSCgWby95FXvj+OeXRCAWVLGZdihQUVHulzqAn+0lhsdDK1UBQ5aXLBE+25ukK9bJ5dLPZvSYYj2d3oMbA=="}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:56.349168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-89ba743c-1d12-4f13-b3b1-98929eddd030 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for project 613f21f4b5164e6087e734f9b447e961. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:56.361465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-89ba743c-1d12-4f13-b3b1-98929eddd030 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for user da46b59a0cb5430589aeef1693b2ce50 and project 613f21f4b5164e6087e734f9b447e961. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:56.449987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89ba743c-1d12-4f13-b3b1-98929eddd030 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.820945 Jul 21 22:33:56.456626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 6/12] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jul 21 22:33:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 823 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 22:33:56.551613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e550024f-c11e-42a8-b6b5-b2b7eb4b74bd tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Calling method '.version_select at 0x7ff1d9fa9550>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:56.915479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac977c3e-1e03-4f66-945f-814d02a2a1bd tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/87ff3251-8a10-4b52-9734-56284eaad0a9" status: 200 len: 350 microversion: 2.1 time: 0.689361 Jul 21 22:33:56.916811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:56 2022] GET /compute/v2.1/os-volumes/87ff3251-8a10-4b52-9734-56284eaad0a9 => generated 350 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:56.935086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fe4f66b6-b0f4-42c4-ac4d-f46eedef2de1 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da8698b0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:57.029525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-e550024f-c11e-42a8-b6b5-b2b7eb4b74bd tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] HTTP exception thrown: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e550024f-c11e-42a8-b6b5-b2b7eb4b74bd tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Request method failure captured: Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 HTTP/1.1 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRHPLe-9Anz_46pQzASnWWYu8fBGG-Zst2omLevNZ45bl5IEjTVjFvbtDkWHpui3LETaNlaGIQlSeK4yS1sXMO30yh_n0KSTTbPk0hAaG2O09D8oMeeGbfTqqY3BvyVTh3DauX1KAti9YNvRqoh5NEPDmC9lo_MLP5sJo3Dtkn1nZs Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 0e7ddc919f5f4aa2a84749f34d5550e1 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesGetTestJSON-1378444873 Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:33:57.034252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e7ddc919f5f4aa2a84749f34d5550e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0e7ddc919f5f4aa2a84749f34d5550e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0e7ddc919f5f4aa2a84749f34d5550e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0e7ddc919f5f4aa2a84749f34d5550e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesGetTestJSON-1378444873 Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 0e7ddc919f5f4aa2a84749f34d5550e1 Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesGetTestJSON-1378444873 Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesGetTestJSON-1378444873-project Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 5621cb413101448c926b37c6519122ac Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesGetTestJSON-1378444873-project Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '4b136d70-0e92-47b1-8dc6-cf2392b85963'} Jul 21 22:33:57.036193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. (HTTP 404) (Request-ID: req-16f3e744-2120-4384-ba70-ae026a598c90) Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:57.037419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:33:57.041141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:33:57.045398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e550024f-c11e-42a8-b6b5-b2b7eb4b74bd tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] Returning 404 to user: Volume 4b136d70-0e92-47b1-8dc6-cf2392b85963 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e550024f-c11e-42a8-b6b5-b2b7eb4b74bd tempest-VolumesGetTestJSON-1378444873 tempest-VolumesGetTestJSON-1378444873-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963" status: 404 len: 109 microversion: 2.1 time: 0.488570 Jul 21 22:33:57.050087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:33:56 2022] GET /compute/v2.1/os-volumes/4b136d70-0e92-47b1-8dc6-cf2392b85963 => generated 109 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:33:57.339764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fe4f66b6-b0f4-42c4-ac4d-f46eedef2de1 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.409476 Jul 21 22:33:57.345399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jul 21 22:33:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:57.361751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7c0362cb-f24d-47e8-a710-ee013630a8a2 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1d9f12940>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:57.800353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7c0362cb-f24d-47e8-a710-ee013630a8a2 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.448509 Jul 21 22:33:57.801560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1148 bytes} [Thu Jul 21 22:33:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:57.816540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f91509e2-3519-4c9a-97c9-97a38150576a tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da869dc0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:58.048864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f91509e2-3519-4c9a-97c9-97a38150576a tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.238705 Jul 21 22:33:58.049923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 9/17] 10.222.0.42 () {58 vars in 1133 bytes} [Thu Jul 21 22:33:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:58.068109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f7c2476-9c29-4111-9baf-13740582cafd tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da87f700>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:58.311688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-438430535", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "networks": [{"uuid": "26c96871-d644-42b8-a708-127beee72083"}]}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:58.319379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f7c2476-9c29-4111-9baf-13740582cafd tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.260896 Jul 21 22:33:58.320888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 10/18] 10.222.0.42 () {58 vars in 1166 bytes} [Thu Jul 21 22:33:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:58.335389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8482ad20-c1c1-41de-923b-41400fe01d75 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da8895e0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:58.662384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] validate_networks() for [('26c96871-d644-42b8-a708-127beee72083', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:58.734496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8482ad20-c1c1-41de-923b-41400fe01d75 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.402613 Jul 21 22:33:58.735475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 11/19] 10.222.0.42 () {58 vars in 1169 bytes} [Thu Jul 21 22:33:58 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:58.747663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52098644-6f81-4e68-a499-06bc7d4e1862 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da87fd30>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:58.958065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52098644-6f81-4e68-a499-06bc7d4e1862 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.214359 Jul 21 22:33:58.965558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 12/20] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jul 21 22:33:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:58.974869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b562658f-9b66-436d-b9fe-70751e21bc06 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da9305e0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:59.096519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b562658f-9b66-436d-b9fe-70751e21bc06 tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.128061 Jul 21 22:33:59.097535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 13/21] 10.222.0.42 () {58 vars in 1187 bytes} [Thu Jul 21 22:33:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:59.113912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-73b4a50a-6bec-483d-9bbf-40347fa6b56d tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] Calling method '.version_select at 0x7ff1da889a60>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:59.535999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-73b4a50a-6bec-483d-9bbf-40347fa6b56d tempest-VolumesTestJSON-213523195 tempest-VolumesTestJSON-213523195-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.427528 Jul 21 22:33:59.536610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 14/22] 10.222.0.42 () {58 vars in 1154 bytes} [Thu Jul 21 22:33:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:02.921269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:34:02.922243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:34:02.922909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:34:02.923602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:34:02.924147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:34:02.937524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:02.941181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:02.949834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:02.950555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:03.024759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Getting quotas for project aa3208211a214b4a9c7face1a1fed6f0. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:03.039232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Getting quotas for user c43bf6734c984c6e9d189660f903958b and project aa3208211a214b4a9c7face1a1fed6f0. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:03.081916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:34:03.095349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:34:03.214737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c0ddc179-8932-4f6d-840b-64242b45de7e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.328176 Jul 21 22:34:03.215399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 9/23] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 5330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:34:03.226923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-330afe37-befb-40af-a735-51e01238ebb9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:03.227828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-330afe37-befb-40af-a735-51e01238ebb9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:03.470981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-330afe37-befb-40af-a735-51e01238ebb9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:03.488418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-330afe37-befb-40af-a735-51e01238ebb9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1214 microversion: 2.1 time: 0.265959 Jul 21 22:34:03.490798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 10/24] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:03 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:03.500944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1623809671", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93ef086a-5e3e-4f5f-be3b-a8a6641e9de2"}], "security_groups": [{"name": "tempest-securitygroup--605998504"}], "key_name": "tempest-keypair-1080856489", "user_data": "}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:03.597370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1026241726", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:03.813695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] validate_networks() for [('f92ffc2d-48a8-4898-8aa3-c6c03158f163', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:34:03.892309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] validate_networks() for [('93ef086a-5e3e-4f5f-be3b-a8a6641e9de2', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:34:05.410802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:34:05.411447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:34:05.411698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:34:05.412262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:34:05.413158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:34:05.463238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.487045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.534682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:05.538592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:05.637787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for project 613f21f4b5164e6087e734f9b447e961. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:05.670381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for user da46b59a0cb5430589aeef1693b2ce50 and project 613f21f4b5164e6087e734f9b447e961. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:05.741337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:34:05.748215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:34:05.961011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ba37bbc8-1aa6-442b-a7ae-e28d93708349 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.468615 Jul 21 22:34:05.962217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 11/25] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jul 21 22:34:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 22:34:05.993905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cefdf36f-4995-48bb-a12c-e110ffee6619 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:05.994796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cefdf36f-4995-48bb-a12c-e110ffee6619 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:06.095483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cefdf36f-4995-48bb-a12c-e110ffee6619 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:06.108288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cefdf36f-4995-48bb-a12c-e110ffee6619 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1214 microversion: 2.1 time: 0.141890 Jul 21 22:34:06.126541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:05 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:06.147925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:06.148910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:06.709440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:06.726148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:06.747563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:06.758233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-57d1e5d2-3a67-4048-82f5-93800765bd10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1282 microversion: 2.20 time: 0.622501 Jul 21 22:34:06.759484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 13/27] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1282 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:06.959583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:34:06.960329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:34:06.961320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:34:06.962915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:34:06.964005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:34:07.043640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:07.047986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:07.051394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:07.054050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:07.134792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-06e99dd9-82ce-4a63-91b1-0eac54df8bc4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:07.135825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-06e99dd9-82ce-4a63-91b1-0eac54df8bc4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:07.343289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:07.359226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-06e99dd9-82ce-4a63-91b1-0eac54df8bc4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:07.378461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for user f93bd44f2fbc4be4be905c8b8ae0e343 and project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:07.395923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-06e99dd9-82ce-4a63-91b1-0eac54df8bc4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1214 microversion: 2.1 time: 0.266979 Jul 21 22:34:07.399102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:07 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:07.497698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:34:07.518821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:34:07.772808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6334ab2-bfbc-4d67-b9e4-09f2f1b5c9c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.715321 Jul 21 22:34:07.776368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 15/29] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:34:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 4721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:34:07.781692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:07.782732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:07.833872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08c302b2-0161-4725-b3b3-897a13bc1b50 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:07.841334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08c302b2-0161-4725-b3b3-897a13bc1b50 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:08.102681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08c302b2-0161-4725-b3b3-897a13bc1b50 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.149622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08c302b2-0161-4725-b3b3-897a13bc1b50 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1222 microversion: 2.1 time: 0.363890 Jul 21 22:34:08.171750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:07 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1222 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:08.210845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.222289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.241421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:08.243302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c521ac0a-3e68-4c03-a284-3dc140e44f39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1282 microversion: 2.20 time: 0.469199 Jul 21 22:34:08.247351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 15/31] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1282 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:08.434637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:08.448139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:08.505642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.507192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.508239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:08.510667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:08.650494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1575677224", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:08.893736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] validate_networks() for [('f92ffc2d-48a8-4898-8aa3-c6c03158f163', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:34:09.330144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:09.368124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-97743cdb-c5de-495d-a63f-4d8c4a5efd1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1218 microversion: 2.1 time: 0.942352 Jul 21 22:34:09.370591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 17/32] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:08 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1218 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:09.397471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:09.398392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:09.421827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.422362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:09.423198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:09.423664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:09.823716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:09.856359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:09.860892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:09.870866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be83890f-e4a8-40de-abb9-9e1ae7e00aa4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1286 microversion: 2.20 time: 0.498525 Jul 21 22:34:09.873113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 18/33] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1286 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:10.085926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:34:10.086932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:34:10.087534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:34:10.092357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:34:10.093296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:34:10.149108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.152539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.156916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.157417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.230124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:34:10.245996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for user f93bd44f2fbc4be4be905c8b8ae0e343 and project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:34:10.319157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:34:10.339815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:34:10.426240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:10.446786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:10.476283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.477631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.482169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.482960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.574038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-43768cb3-86db-4225-9f44-9ad0c439cccb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.935991 Jul 21 22:34:10.587906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 16/34] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:34:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:34:10.618466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-05f75e72-fe08-4ba6-95f1-f77e7fe9fe38 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:10.627673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-05f75e72-fe08-4ba6-95f1-f77e7fe9fe38 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:10.839526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:10.887378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3218d99d-2f39-4c4c-85fc-82b68ca39bb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1266 microversion: 2.1 time: 0.478336 Jul 21 22:34:10.901737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:10 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:10.912472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:10.913553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:10.952933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.953650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:10.955027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:10.955886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.177629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-05f75e72-fe08-4ba6-95f1-f77e7fe9fe38 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:11.189829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-05f75e72-fe08-4ba6-95f1-f77e7fe9fe38 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1222 microversion: 2.1 time: 0.584133 Jul 21 22:34:11.203568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 17/36] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:10 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1222 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:11.212296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:11.295516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:11.311767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:11.322361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5743abd2-37d4-43c7-a5de-f427f311ab39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1278 microversion: 2.20 time: 0.421076 Jul 21 22:34:11.327003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 20/37] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1278 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:11.918222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:11.919527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:11.948667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.948816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:11.952371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:11.952975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:12.226515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:12.227145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:12.256314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:12.258103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:12.276404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:12.285264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:13.112871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:13.135594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1dd65319-25d9-4639-8906-396d8319ceea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1226 microversion: 2.1 time: 0.904765 Jul 21 22:34:13.145181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 21/38] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:12 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1226 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:13.165287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:13.166572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:13.191874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:13.192583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:13.193749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:13.194578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:13.380619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:13.401743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b4982019-49a0-4847-84f3-195e0e1a6610 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1272 microversion: 2.1 time: 1.487874 Jul 21 22:34:13.407629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:13.424678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 18/39] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:11 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1272 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:13.425634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:13.438453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:13.442529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-40380b27-d693-468f-b751-314a8abf8d90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1352 microversion: 2.20 time: 0.293274 Jul 21 22:34:13.445092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 22/40] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1352 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:14.155809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:14.157051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:14.170980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.171784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.185938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.187304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.399823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:14.438697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:14.439578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:14.445056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a275ee42-8443-456a-bffb-95da338d59ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1218 microversion: 2.1 time: 0.294877 Jul 21 22:34:14.448051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 19/41] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:14 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:14.463641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:14.464283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:14.478570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.482588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.486600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.487098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.489082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.489705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.494859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:14.496229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:14.735678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:14.753466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:14.756010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:14.764596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c707ec50-6e00-49a1-9de2-445a41aea88a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1352 microversion: 2.20 time: 0.306256 Jul 21 22:34:14.767539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 20/42] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1352 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:15.088210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:15.110622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-453d2a31-e930-4e2a-ae9c-1c05a12479bd tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.676325 Jul 21 22:34:15.113369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 23/43] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:14 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:15.467753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:15.468466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:15.487371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.488225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:15.490689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.491518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:15.801387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:15.802291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:15.817613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.820403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:15.821976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:15.825148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:16.197107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:16.214104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:16.219011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:16.223374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc15e731-cb7a-48cb-ad40-c43b11072a2c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1352 microversion: 2.20 time: 0.426120 Jul 21 22:34:16.226643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 24/44] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1352 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:16.255168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:16.256448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:16.281069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:16.292042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:16.297209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:16.300247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:16.306242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dc2f8b26-a6eb-41ee-a87e-b0a6c31bf4b6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1218 microversion: 2.1 time: 0.831901 Jul 21 22:34:16.317256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:16.319660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 21/45] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:15 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1218 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:16.585141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:16.596788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8da7b814-4135-440d-ae2a-004f89eecf25 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.357717 Jul 21 22:34:16.598931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 25/46] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:16 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:17.261271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:17.264718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:17.284554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.285481 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.287669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.290024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.327448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:17.343453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:17.359288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:17.409390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.410572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.412308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.413497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.654386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:17.675600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac115536-dd5f-4576-97aa-dc6df4c84137 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1274 microversion: 2.1 time: 0.349034 Jul 21 22:34:17.680524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 26/47] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:17 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1274 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:17.703093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:17.703808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:17.729053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.729495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.733368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:17.734040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:17.748975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:17.775544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:17.787981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:17.791524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4afcc144-b814-46b7-a1b9-1af7181f7503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1340 microversion: 2.20 time: 0.533766 Jul 21 22:34:17.810191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 22/48] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1340 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:18.148572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=8 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:18.169858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:18.185415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-05ec581b-42bd-4189-bc71-98f70e137fc2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.492040 Jul 21 22:34:18.186386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 27/49] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:17 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:18.703936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:18.706174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:18.728074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.729482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:18.731765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.732935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:18.834502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:18.845300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:18.846121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:18.853911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7e8a1d2e-4a1a-4b05-967b-63c13bd6fdac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1274 microversion: 2.1 time: 0.159701 Jul 21 22:34:18.855514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 23/50] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:18 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:18.868429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.869663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:18.871328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:18.872926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:19.100284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:19.116574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:19.120545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:19.127809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8456e878-afd8-4528-aede-703ad9934c3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1340 microversion: 2.20 time: 0.300132 Jul 21 22:34:19.129963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 28/51] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1340 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:19.211639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:19.212378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:19.221154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:19.222790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:19.223242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:19.224021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:19.231504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:19.623838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:19.633583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b83e952e-871e-4188-b18f-f1c7d416a17f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.425863 Jul 21 22:34:19.634646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 24/52] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:19 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:19.884507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:19.885943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:19.911389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:19.912154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:19.914018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:19.914467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.093450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:20.113997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94bde4c0-653a-4f29-8bf3-71cd585199b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1274 microversion: 2.1 time: 0.244697 Jul 21 22:34:20.118276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 29/53] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:19 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:20.152463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:20.154404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:20.190527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.191052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.201553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.206683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.207528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:20.451969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:20.475178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:20.483773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:20.493561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-75a8e74e-69d5-43ad-84cf-53988fdf543e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1340 microversion: 2.20 time: 0.347502 Jul 21 22:34:20.495182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 25/54] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1340 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:20.662634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:20.663317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:20.681142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.685934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:20.689331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:20.689819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.136047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:21.136734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:21.155091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.156155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.156330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.156844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.189567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=34 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:21.575526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:21.587609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e3eda39a-0b30-4943-8cd9-7e1d1c692b1e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.929808 Jul 21 22:34:21.601210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 30/55] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:20 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:21.609796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:21.610444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:21.611087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:21.635322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.636062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.637068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:21.640077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:21.643949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-98c8c4e2-7a6e-45e0-bf14-d210cd3e8835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1282 microversion: 2.1 time: 0.510462 Jul 21 22:34:21.658981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 26/56] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:21 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1282 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:22.056629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:22.086458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:22.088261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:22.089487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b453e68e-3103-4806-a76d-c041ad0db89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1340 microversion: 2.20 time: 0.486231 Jul 21 22:34:22.092690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 31/57] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1340 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:22.609804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:22.611154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:22.621561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.625663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:22.633103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.634510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:22.664859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:22.665586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:22.677864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.679327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:22.693888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.697003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.133448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.144741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70b3a5f1-ab79-4ad1-b246-e5c08fb1db90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1282 microversion: 2.1 time: 0.483195 Jul 21 22:34:23.150118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 32/58] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:22 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1282 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:23.166511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:23.167611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:23.182336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.182934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.184074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.185516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.214509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:23.355940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.392534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-40d6b3a5-8df6-42c1-b434-3737b3040d5b tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.786909 Jul 21 22:34:23.417665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:22 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:23.465164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.514632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.533237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:23.539555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-80223a7a-aafc-4027-a074-3e9b9741942b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.385014 Jul 21 22:34:23.543231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 33/60] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:23.660688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-6b118d60-a786-45e8-8807-d58e47549edb req-f1c0c1d6-d661-442e-9c89-c7d011f016d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "346cdaf4-2c29-4dd7-aae1-06e8e7954ed8", "tag": "661043a8-67a1-4492-a79b-152142d627f0"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:23.679566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-6b118d60-a786-45e8-8807-d58e47549edb req-f1c0c1d6-d661-442e-9c89-c7d011f016d5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.680012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-6b118d60-a786-45e8-8807-d58e47549edb req-f1c0c1d6-d661-442e-9c89-c7d011f016d5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.704176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-6b118d60-a786-45e8-8807-d58e47549edb req-f1c0c1d6-d661-442e-9c89-c7d011f016d5 service nova] Creating event network-changed:661043a8-67a1-4492-a79b-152142d627f0 for instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 on hv-cinder-85069 Jul 21 22:34:23.705032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-6b118d60-a786-45e8-8807-d58e47549edb req-f1c0c1d6-d661-442e-9c89-c7d011f016d5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:34:23.706380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.707005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.708001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.708640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:23.720040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.compute.rpcapi [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:34:23.720994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=124534) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:34:23.738172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c6b3c1d9-ee63-4806-be3c-92c685c608c2 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318336 Jul 21 22:34:23.739094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 28/61] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:23.899658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-abad56dc-fc3e-4aa0-ac04-4c283c22a6e4 req-61c4cc5a-07ba-4bf8-bd1d-b2a1948f5033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b07743-4b75-4d9f-8230-5cc93fc5ed80", "tag": "11d25a6b-1022-43a4-824d-f35dc0c23dcc"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:23.949949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-abad56dc-fc3e-4aa0-ac04-4c283c22a6e4 req-61c4cc5a-07ba-4bf8-bd1d-b2a1948f5033 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:23.950503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-abad56dc-fc3e-4aa0-ac04-4c283c22a6e4 req-61c4cc5a-07ba-4bf8-bd1d-b2a1948f5033 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.007434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-abad56dc-fc3e-4aa0-ac04-4c283c22a6e4 req-61c4cc5a-07ba-4bf8-bd1d-b2a1948f5033 service nova] Creating event network-changed:11d25a6b-1022-43a4-824d-f35dc0c23dcc for instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 on hv-cinder-85069 Jul 21 22:34:24.015025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-abad56dc-fc3e-4aa0-ac04-4c283c22a6e4 req-61c4cc5a-07ba-4bf8-bd1d-b2a1948f5033 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 22:34:24.015025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.015417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.016088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.018727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.048447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.compute.rpcapi [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 22:34:24.049429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] Releasing lock "compute-rpcapi-router" {{(pid=124535) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 22:34:24.111196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-20572b55-61af-4ffb-a224-f89735c5ff91 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.564852 Jul 21 22:34:24.111841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 34/62] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:24.175838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:24.177239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:24.207097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.207784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.213058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.214250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.456127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:24.460431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:24.482107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.483436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.484828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.485447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.610715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:24.639672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f460c67-f6f2-4c3b-ac2a-1a6238ce6ac5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1292 microversion: 2.1 time: 0.468488 Jul 21 22:34:24.646315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 29/63] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:24 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1292 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:24.665630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:24.670649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:24.681442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.682106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:24.683816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:24.686002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:25.022987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:25.034777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-64517353-4e1e-4e74-bbac-3739c2e514bc tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.591024 Jul 21 22:34:25.048327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 35/64] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:24 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:25.671848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:25.676700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:25.705221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:25.724170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:25.732656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:25.732656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:25.733593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:25.734614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:25.744102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:25.745848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:25.747605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f7eb863-1d16-4c9c-bebb-84e6ba08abac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 1.097621 Jul 21 22:34:25.761068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 30/65] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:26.055339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:26.055957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:26.072965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.073406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:26.078383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.079471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:26.166479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:26.218967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-959e2568-c946-4d54-b2f6-6ce0d42c106f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1280 microversion: 2.1 time: 0.555678 Jul 21 22:34:26.222960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 36/66] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:25 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1280 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:26.806296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:26.813370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:26.838115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.839002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:26.852605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:26.853905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:27.068307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.085025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8e95401a-314a-412f-b455-5abe06a8f2aa tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 1.033480 Jul 21 22:34:27.091500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 31/67] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:26 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:27.265784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:27.266789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:27.281502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:27.282534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:27.283556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:27.286603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:27.466496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.478550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.489483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.491411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-02298f12-a3ee-4c9b-a459-5ca4ebadee32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.714828 Jul 21 22:34:27.502775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 37/68] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:27.860387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:27.878146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00f0cad7-672e-4ccd-84c1-1443a1f1c993 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1280 microversion: 2.1 time: 0.619454 Jul 21 22:34:27.879197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 32/69] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:27 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1280 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:28.113420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:28.120961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:28.149156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.150210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.151685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.152531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.478679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:28.488118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ba6a4881-4abd-4f8a-8622-f4d693661f40 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.383885 Jul 21 22:34:28.489301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 38/70] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:28 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:28.518476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:28.541316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:28.572029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.573370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.577115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.585009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.904648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:28.906476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:28.927444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.928300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.929321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:28.930285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:28.995632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:29.007348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:29.055159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:29.067094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:29.074825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0e0e2e89-e858-4680-a6d0-548aa241eb91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.566974 Jul 21 22:34:29.079819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 33/71] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:29.148231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-47517ff6-99ed-432f-b569-6398a9a6b797 req-fe99d60d-340b-4d08-9233-106e48aa7228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:29.181868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-47517ff6-99ed-432f-b569-6398a9a6b797 req-fe99d60d-340b-4d08-9233-106e48aa7228 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:29.184076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-47517ff6-99ed-432f-b569-6398a9a6b797 req-fe99d60d-340b-4d08-9233-106e48aa7228 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:29.235521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-47517ff6-99ed-432f-b569-6398a9a6b797 req-fe99d60d-340b-4d08-9233-106e48aa7228 service nova] Creating event network-changed:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:34:29.250683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-47517ff6-99ed-432f-b569-6398a9a6b797 req-fe99d60d-340b-4d08-9233-106e48aa7228 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106662 Jul 21 22:34:29.255961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 34/72] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:29.256824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:29.287134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3817f862-979e-429f-b78b-d51dc304a6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.390135 Jul 21 22:34:29.290705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 39/73] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:28 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:29.551895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:29.556953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:29.604976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:29.607338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:29.625570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:29.626380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:30.112447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:30.121960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:30.128906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:30.157059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:30.159720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:30.161207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:30.164029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:30.167239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-22ea1a58-1a80-4296-854e-e577fd1a594e tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.649167 Jul 21 22:34:30.175155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 35/74] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:29 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:30.315902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:30.326573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:30.364193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:30.364953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:30.379399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:30.389309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:31.545999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:31.572941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:31.574791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:31.575984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc98fe48-e94c-4be6-8be2-530af1c0c21d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 1.480683 Jul 21 22:34:31.587202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 40/75] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:31.614293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:31.635028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:31.649022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:31.651575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:31.654333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:31.655680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:31.951985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:31.982232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-afad9963-aef6-4934-8009-6c9cd2fcdac3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 1.676541 Jul 21 22:34:31.989919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 36/76] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:30 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:32.636035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:32.649004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:32.708157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:32.713224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:32.714362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:32.722897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:32.724277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:32.739237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6af0fc70-50d5-46d2-bdc1-c7614cf5beb7 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 1.145168 Jul 21 22:34:32.742971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 41/77] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:31 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:33.024896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:33.031858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:33.093612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.095100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.102703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.112399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.717457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:33.884963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:33.905206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f1694dd1-697f-4199-a288-a4a36122a1dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.889743 Jul 21 22:34:33.907116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 42/78] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:33 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:33.942446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:33.944421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:33.963449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.965062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:33.967122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:33.969476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:34.043126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:34.398833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:34.419638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-541c2fb5-7b4d-4671-b87a-3d442aef1d6f tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.490426 Jul 21 22:34:34.445898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:33 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:34.941256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:34.942322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:34.949336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:34.950326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:34.951639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:34.952596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.201117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.248163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.250865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.255809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d0b243d-8ecd-4314-9794-852217baa341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 2.637187 Jul 21 22:34:35.260273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 37/80] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 2644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:35.397575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.408345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7fd072e6-9b07-406f-b0a4-0295223de48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.471004 Jul 21 22:34:35.420126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 44/81] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:34 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:35.465260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:35.466063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:35.480334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:35.481690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.483505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:35.484897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.864221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:35.878843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d4a88da-0b03-4b6a-b2c7-b5fae43ef75c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.419911 Jul 21 22:34:35.881701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 38/82] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:35 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:35.886304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-b8e5bb25-5c93-4b91-9a40-24a83df8f598 req-98fd8c58-36a2-4e4c-a52f-344356491adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a02651-3341-4946-b6e2-4384b05df109", "tag": "5c6a29a4-9595-4866-a09d-cb85249f6fb8"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:35.904832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-b8e5bb25-5c93-4b91-9a40-24a83df8f598 req-98fd8c58-36a2-4e4c-a52f-344356491adf service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:35.905748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-b8e5bb25-5c93-4b91-9a40-24a83df8f598 req-98fd8c58-36a2-4e4c-a52f-344356491adf service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:35.941106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-b8e5bb25-5c93-4b91-9a40-24a83df8f598 req-98fd8c58-36a2-4e4c-a52f-344356491adf service nova] Creating event network-changed:5c6a29a4-9595-4866-a09d-cb85249f6fb8 for instance c0a02651-3341-4946-b6e2-4384b05df109 on hv-cinder-85069 Jul 21 22:34:35.953197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-b8e5bb25-5c93-4b91-9a40-24a83df8f598 req-98fd8c58-36a2-4e4c-a52f-344356491adf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076004 Jul 21 22:34:35.959178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 45/83] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:36.288379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:36.290657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:36.300504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.301309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.302378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.303016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.430897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:36.431786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:36.447911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.451390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.452657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.454227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.625631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:36.647124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:36.654158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:36.655520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d1d5313b-3319-489a-bcc9-d7006d165c74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.376531 Jul 21 22:34:36.658120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 39/84] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:36.738519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:36.750044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be748d04-94d8-47d3-89ca-c538273b3785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.327176 Jul 21 22:34:36.750894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 46/85] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:36 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:36.907414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:36.908202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:36.914941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.915661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:36.916903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:36.917341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.114116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:37.125804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f149e34d-b719-459e-8511-1659f451fd56 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.223010 Jul 21 22:34:37.127867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 40/86] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:36 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:37.677785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:37.679021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:37.687938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.688808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.689883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.690584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.774033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:37.774874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:37.786478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.786926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.787723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.790425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.014809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.033225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.035372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.040591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9d573b40-6307-491e-b6a7-df21b70b1104 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.368464 Jul 21 22:34:38.042430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 47/87] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:38.150496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:38.151649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:38.179978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.189128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.192011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.192665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.796427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.807380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5a2cd21e-fba0-4289-be26-6c31a97a05c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 1.038064 Jul 21 22:34:38.817191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 41/88] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:37 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:38.978756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.998086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-426aa1c0-e24d-4b4c-999c-9706b3169778 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.852939 Jul 21 22:34:38.998700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 48/89] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:38 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:39.080295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:39.081848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:39.098307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.098773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.099573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.100014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.408831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.433756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.433756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.437628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-69ed6706-487e-4e74-9bf3-baa71a9ac9f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.362342 Jul 21 22:34:39.440537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 42/90] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:39.834029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:39.834653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:39.856985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.857495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.861421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.862086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.019948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:40.021847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:40.034584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.037076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.039328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.042045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.311080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.334462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0d999fe8-30bb-4c5c-9b52-c41439fa8219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.503753 Jul 21 22:34:40.335414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 49/91] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:39 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:40.467223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:40.468053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:40.496672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.496672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.500268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.503526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.888772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.892972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:40.904067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.909456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.919110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.920955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b3126170-8880-4c7b-9f66-9fb04c5f2f00 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.461837 Jul 21 22:34:40.923138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 50/92] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:40.970559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6b49ce80-f497-4833-8032-80f20ca6f92c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.954128 Jul 21 22:34:40.982776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 43/93] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:40 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:41.355793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:41.356515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:41.367205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.372109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.373272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.374878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.669905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:41.688452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-610174b3-feed-47ac-bf72-85e46cd93710 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.337226 Jul 21 22:34:41.709479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 51/94] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:41 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:41.716597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-97534c97-963d-4d58-a0b0-8b404e2b8207 req-6b41601b-399a-4b84-a8ad-7c299343bf86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "346cdaf4-2c29-4dd7-aae1-06e8e7954ed8", "name": "network-vif-plugged", "status": "completed", "tag": "661043a8-67a1-4492-a79b-152142d627f0"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:41.734599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-97534c97-963d-4d58-a0b0-8b404e2b8207 req-6b41601b-399a-4b84-a8ad-7c299343bf86 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.736464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-97534c97-963d-4d58-a0b0-8b404e2b8207 req-6b41601b-399a-4b84-a8ad-7c299343bf86 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.763582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-97534c97-963d-4d58-a0b0-8b404e2b8207 req-6b41601b-399a-4b84-a8ad-7c299343bf86 service nova] Creating event network-vif-plugged:661043a8-67a1-4492-a79b-152142d627f0 for instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 on hv-cinder-85069 Jul 21 22:34:41.770940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-97534c97-963d-4d58-a0b0-8b404e2b8207 req-6b41601b-399a-4b84-a8ad-7c299343bf86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157872 Jul 21 22:34:41.771968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 44/95] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:41.945535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:41.946896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:41.956932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.956932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.960180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.960728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.990717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:41.991525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:42.002544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.003000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.003818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.004265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.173997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.184385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.186223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.187352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0aa0163b-8299-4eba-b4e0-ef60535b5bcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.250157 Jul 21 22:34:42.188702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 52/96] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:42.266068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:42.275632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0fe7268b-ab62-4089-857f-5ae5308a470c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.289708 Jul 21 22:34:42.276636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 45/97] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:41 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:42.716140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:42.716940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:42.725907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.731196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.732266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.732890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.056444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.072669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b3c89c3-d824-457a-be11-60b051a2a4bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.361021 Jul 21 22:34:43.074295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 53/98] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:42 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:43.207294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:43.208892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:43.233720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.234192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.235322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.237670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.296926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:43.296926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:43.312667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.313442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.314603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.317013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.462019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.481146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.488430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.490366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7d058a0e-5ae9-4700-a333-e8ae5c6ef1b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.288336 Jul 21 22:34:43.491327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 46/99] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:43.582170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:43.591768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-54405f48-46a1-4de1-bef6-76a580e25840 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.301712 Jul 21 22:34:43.592593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 54/100] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:43 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:43.793588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-01e0010d-6f3d-4d2b-95d3-9f2908676a96 req-0a300996-4a3c-4c79-996e-a82926031b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b07743-4b75-4d9f-8230-5cc93fc5ed80", "name": "network-vif-plugged", "status": "completed", "tag": "11d25a6b-1022-43a4-824d-f35dc0c23dcc"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:43.810977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-01e0010d-6f3d-4d2b-95d3-9f2908676a96 req-0a300996-4a3c-4c79-996e-a82926031b4d service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:43.812131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-01e0010d-6f3d-4d2b-95d3-9f2908676a96 req-0a300996-4a3c-4c79-996e-a82926031b4d service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:43.835303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-01e0010d-6f3d-4d2b-95d3-9f2908676a96 req-0a300996-4a3c-4c79-996e-a82926031b4d service nova] Creating event network-vif-plugged:11d25a6b-1022-43a4-824d-f35dc0c23dcc for instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 on hv-cinder-85069 Jul 21 22:34:43.845127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-01e0010d-6f3d-4d2b-95d3-9f2908676a96 req-0a300996-4a3c-4c79-996e-a82926031b4d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057665 Jul 21 22:34:43.847026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 47/101] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:44.097991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:44.100881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:44.114129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.115390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.116812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.117540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.375439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.393835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f64f1bc2-71f1-45c4-9d19-68a35d13acd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.303371 Jul 21 22:34:44.395698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 55/102] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:44 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:44.513007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:44.514416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:44.522723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.523409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.524546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.525214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.618632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:44.619853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:44.650674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.651434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.653684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:44.654471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:44.765015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.778999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.781398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.783244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2a4bc872-5d15-49b3-aae0-a29b49442de7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.276367 Jul 21 22:34:44.785129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 48/103] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:44.925956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:44.945238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eae260bd-89e6-41ee-bcd1-c91e7dc28d2c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.335346 Jul 21 22:34:44.949185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 56/104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:44 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:45.413827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:45.414878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:45.422456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.423289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.424339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.425049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.599995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:45.608661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-461af2f4-01f8-4187-8ea8-4c55c66f824c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.199434 Jul 21 22:34:45.609444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:45 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:45.809605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:45.810664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:45.822528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.822991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.824959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.825429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.867021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-42c9829e-4a84-4f5b-b108-10ad13cb987c req-a6f80391-96a7-4252-8585-16d9b24d54d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "name": "network-vif-plugged", "status": "completed", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:45.906493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-42c9829e-4a84-4f5b-b108-10ad13cb987c req-a6f80391-96a7-4252-8585-16d9b24d54d4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.906935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-42c9829e-4a84-4f5b-b108-10ad13cb987c req-a6f80391-96a7-4252-8585-16d9b24d54d4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.936369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-42c9829e-4a84-4f5b-b108-10ad13cb987c req-a6f80391-96a7-4252-8585-16d9b24d54d4 service nova] Creating event network-vif-plugged:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:34:45.954929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-42c9829e-4a84-4f5b-b108-10ad13cb987c req-a6f80391-96a7-4252-8585-16d9b24d54d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090425 Jul 21 22:34:45.958604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 50/106] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:45.975514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:45.976830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:45.992353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.992997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:45.996159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:45.997480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.036152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.050075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.053648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.054238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1fd77e0d-0a18-4c94-a90d-0ce18d09ba67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.250811 Jul 21 22:34:46.070465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 57/107] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:34:46.202356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.211514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-352abc94-dc95-414a-9581-d3ce0375fea4 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1314 microversion: 2.1 time: 0.251434 Jul 21 22:34:46.212099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 51/108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:45 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:46.633729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:46.634342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:46.643797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.644242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.645046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:46.645651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:46.824455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:46.832494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6c348b3a-af29-4b08-a075-f381e7ad15d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.209504 Jul 21 22:34:46.833136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:46 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:47.081350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:47.082016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:47.090349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.090872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.091692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.092165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.231421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:47.233349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:47.240396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.243606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.248888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.249779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.250218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.254315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.255879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.257095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-254e32e2-659c-4d9a-b450-6507b61c3bca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.180452 Jul 21 22:34:47.257674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 52/110] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:47.432373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:47.455217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-47a8a4d9-c965-4035-b627-180501840fab tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1500 microversion: 2.1 time: 0.229158 Jul 21 22:34:47.456255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 59/111] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:47 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:47.851516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:47.852291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:47.859381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.860229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.861209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.861857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:47.866764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:47.976156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-d182157b-4d65-4d52-a768-f12cd2735df4 req-6c15ca24-5272-4aeb-bce2-e76806a6c5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a02651-3341-4946-b6e2-4384b05df109", "name": "network-vif-plugged", "status": "completed", "tag": "5c6a29a4-9595-4866-a09d-cb85249f6fb8"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:47.987955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-d182157b-4d65-4d52-a768-f12cd2735df4 req-6c15ca24-5272-4aeb-bce2-e76806a6c5b8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:47.988418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-d182157b-4d65-4d52-a768-f12cd2735df4 req-6c15ca24-5272-4aeb-bce2-e76806a6c5b8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.014882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-d182157b-4d65-4d52-a768-f12cd2735df4 req-6c15ca24-5272-4aeb-bce2-e76806a6c5b8 service nova] Creating event network-vif-plugged:5c6a29a4-9595-4866-a09d-cb85249f6fb8 for instance c0a02651-3341-4946-b6e2-4384b05df109 on hv-cinder-85069 Jul 21 22:34:48.021262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-d182157b-4d65-4d52-a768-f12cd2735df4 req-6c15ca24-5272-4aeb-bce2-e76806a6c5b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048817 Jul 21 22:34:48.025430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 60/112] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:48.067764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:48.076152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6622b956-a85c-4d9c-8a39-7d015dde7f94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.228572 Jul 21 22:34:48.079584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:47 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:48.277564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:48.278358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:48.285161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.285670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.286394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:48.286906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:48.426764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:48.435621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:48.437077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:48.438213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b41da546-62b7-4873-a98f-d4cdf00bf873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.165674 Jul 21 22:34:48.438784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 61/114] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:49.094107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:49.094720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:49.100875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.101324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.102081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.102506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.252573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.260995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5bb45ddc-0d18-40a9-9b6b-813d53ee382c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.171097 Jul 21 22:34:49.261630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:49 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:49.456977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:49.457612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:49.463564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.465259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.466076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:49.466511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:49.641539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.653187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.655454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:49.657097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afd5051c-86b7-4d1a-8c96-5f23e6c4c4da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.204513 Jul 21 22:34:49.658248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 62/116] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:50.288039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:50.289865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:50.292870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=61 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:50.300199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.300871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.301821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.302357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.538984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:50.561962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8176714-b3ef-4bf7-9913-9109a1254433 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.280201 Jul 21 22:34:50.562640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 55/117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:50 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:50.678667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:50.680263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:50.692325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.693021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.697134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:50.697591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:50.910048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:50.923355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:50.925313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:50.926771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-66e975ec-a739-4fd3-83e6-5fc2253a0cee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1407 microversion: 2.20 time: 0.254431 Jul 21 22:34:50.929080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 63/118] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:51.197089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a050739-d480-4fff-ac2f-fd607fd9d20f"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:51.199130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:51.213363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.213363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.213363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.213363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.580898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:51.586042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:51.591046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.591046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.592512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.592953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.804784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:51.816580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-863c069c-2260-46c8-ab9c-8a6767713362 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.240324 Jul 21 22:34:51.818399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 64/119] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:51 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:51.954929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:51.955691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:51.964263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.965168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:51.967780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:51.968404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.222171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:52.234051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:52.235640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:52.237282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-883feba9-3d8b-43b0-a9d8-7015df1e2b04 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1599 microversion: 2.20 time: 0.289438 Jul 21 22:34:52.238474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 65/120] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:34:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1599 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:34:52.270357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:52.270859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:52.279982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.280626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.281823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.283522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.394501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00387564-fed2-4091-b41b-b59eaedb26ef tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "POST /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202140 Jul 21 22:34:52.395208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 56/121] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 22:34:51 2022] POST /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:52.477557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5b7cdb43-bc9d-4cf5-829f-283b722108e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.212677 Jul 21 22:34:52.478284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 66/122] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jul 21 22:34:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:34:52.848824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:52.850677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:52.867377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.868866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:52.870732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:52.871470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:53.112448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:53.126173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-54ed6cfb-b6d0-4bab-a614-6146d08ab5b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1322 microversion: 2.1 time: 0.290003 Jul 21 22:34:53.127582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 57/123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:52 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:54.150195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:54.150980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:54.161315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.162153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.163274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.164185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.210420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-7ca4284c-6798-450f-92ad-c31d1beb9d7f req-9274415d-bbf0-4ecf-818f-34bce67d4835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:54.227473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7ca4284c-6798-450f-92ad-c31d1beb9d7f req-9274415d-bbf0-4ecf-818f-34bce67d4835 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.230857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7ca4284c-6798-450f-92ad-c31d1beb9d7f req-9274415d-bbf0-4ecf-818f-34bce67d4835 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.262482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-7ca4284c-6798-450f-92ad-c31d1beb9d7f req-9274415d-bbf0-4ecf-818f-34bce67d4835 service nova] Creating event network-changed:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:34:54.273979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-7ca4284c-6798-450f-92ad-c31d1beb9d7f req-9274415d-bbf0-4ecf-818f-34bce67d4835 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066756 Jul 21 22:34:54.275682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 58/124] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:54.354020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:54.363725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-459ab159-9731-4b27-af6b-b5c2509610e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1515 microversion: 2.1 time: 0.217853 Jul 21 22:34:54.364852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 67/125] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:54 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:34:54.384246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:54.385467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:54.392242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.392762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.393545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.393975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.445925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lazy-loading 'flavor' on Instance uuid c0a02651-3341-4946-b6e2-4384b05df109 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:34:54.700601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-59c14c0d-8c5f-41ea-8b42-76df6bcf44da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109/action" status: 200 len: 32 microversion: 2.1 time: 0.321052 Jul 21 22:34:54.702349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 59/126] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:34:54 2022] POST /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109/action => generated 32 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:34:54.724906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:54.725770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:54.734682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.735355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.736544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:54.737220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:54.786640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:54.966478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:54.974543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-255c377e-d764-4999-a999-a8acf3386f95 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.264472 Jul 21 22:34:54.975241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 68/127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:54 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:55.996309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:55.998077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:56.007134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.008211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.009507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:56.010206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:56.262495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:56.285546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d2fb049-5343-479e-b45b-9d13136a58dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.293323 Jul 21 22:34:56.292695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 60/128] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:55 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:57.315756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:57.316415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:57.320058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=66 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:57.331364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.331824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.332653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:57.333087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:57.490740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:57.502855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-976fc313-ff75-459b-bb9b-9927c6a3aa0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.191143 Jul 21 22:34:57.503445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 69/129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:57 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:58.520973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:58.521579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:58.529630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.530080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:58.530874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:58.531304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:58.688242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:58.696872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5d902902-cb47-4ad7-aa5b-224c7fac3a12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.179596 Jul 21 22:34:58.697470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 61/130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:58 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:59.719553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:59.720739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:59.733353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:59.734151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:59.735924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:59.736722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:59.938803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:59.946919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96ff1b79-d41c-4517-a59c-3a866987810e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.235293 Jul 21 22:34:59.947497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 70/131] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:59 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:00.969169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:00.970488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:00.977516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.978042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:00.979316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:00.980074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:01.188722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:01.198284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8afc48df-30f7-4e35-ab57-d14378cc9c12 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.234424 Jul 21 22:35:01.198890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 62/132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:00 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:02.215836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:02.216626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:02.230436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.231181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.235257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:02.235821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:02.625939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:02.642952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-af89ccbe-dd18-41d6-872a-fec3764dd89b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.430516 Jul 21 22:35:02.658725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 71/133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:02 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:03.672590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:03.673906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:03.687741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.688247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:03.689602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:03.690437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:03.944136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:03.967271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-954087aa-11c2-433d-b2f4-1d8326854f57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.300376 Jul 21 22:35:03.982101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 63/134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:03 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:05.001478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:05.002717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:05.014875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:05.015686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:05.017150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:05.017960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:05.200884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:05.209944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5a56969-cab6-4e34-893c-9dc16c7f5ba0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.216879 Jul 21 22:35:05.210533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 72/135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:04 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:06.230784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:06.232279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:06.240428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.241235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.242522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:06.243234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:06.442530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:06.451640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d25bdd51-81df-4966-a21a-db2a56234924 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.227261 Jul 21 22:35:06.454786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:06 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:07.469974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:07.470830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:07.479623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.480087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:07.480974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:07.481406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:07.678730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:07.688241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-34a038ba-6dd1-4ec2-a2da-525bc15ba50c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.221975 Jul 21 22:35:07.689156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:07 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:08.715311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:08.716428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:08.726617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:08.727134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:08.728655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:08.729145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:08.892295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:08.908356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-19378f37-beb9-4380-b696-c3354a140588 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.197788 Jul 21 22:35:08.909795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 65/138] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:08 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:09.932436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:09.934046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:09.943992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.944812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:09.946225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:09.947040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:10.204277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:10.217676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-99476afa-efc7-4be0-aa8d-098ad6e68c69 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.293177 Jul 21 22:35:10.218853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 74/139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:09 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:11.261594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:11.263315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:11.279108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.279108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.279108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:11.279108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:11.471069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:11.485579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5ca32c1d-9103-47cb-9a77-8b673cedfb07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.245592 Jul 21 22:35:11.486769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:11 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:12.510237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:12.510862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:12.517369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.517886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.518740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.519292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.532878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:12.533690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:12.560858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.562169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.563509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.564247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.579362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:12.626338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:35:12.763589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:12.784524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-358e2f2f-1214-4238-b7d9-387522be6ed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.276967 Jul 21 22:35:12.786402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 75/141] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:12 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:12.807675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cef7caa3-852b-437f-9981-a5d022c0e174 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 204 len: 0 microversion: 2.1 time: 0.280637 Jul 21 22:35:12.808849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 67/142] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:35:12 2022] DELETE /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:35:12.818626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:12.820003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:12.830035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.830656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:12.831862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:12.832522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.002936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:13.014005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f772b920-2ac7-42a1-b5c9-5abf07aac894 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1552 microversion: 2.1 time: 0.200398 Jul 21 22:35:13.015002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:12 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:13.804415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:13.805330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:13.814159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.814988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:13.815978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:13.816433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.035735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.043560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:14.044857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:14.052434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:14.053195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.054003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:14.054433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:14.054721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fdf8d394-a71c-44fe-9ff0-8a97d2fca163 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.254350 Jul 21 22:35:14.056038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 68/144] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:13 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:14.354176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:14.366886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ae8f02cd-6bc1-483b-94e8-2307bc4df4c2 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1552 microversion: 2.1 time: 0.328035 Jul 21 22:35:14.369349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 77/145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:14 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1552 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:15.094730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:15.096344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:15.114091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.114954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.117413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.119458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.387550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:15.388812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:15.408173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.408662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.409441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:15.410058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:15.457141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.509978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b4e625e3-e1c0-4098-8cd3-e97a05dbbfee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.420223 Jul 21 22:35:15.511132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 69/146] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:15 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:15.637673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:15.646718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-621ac7f4-1360-4efc-a341-3c434898071a tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1552 microversion: 2.1 time: 0.264373 Jul 21 22:35:15.647689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 78/147] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:15 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1552 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:16.506455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-d125c043-0825-49ca-ae7e-57b2ad4df255 req-77f5aa5c-6929-4974-b057-cafe7fb745b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b07743-4b75-4d9f-8230-5cc93fc5ed80", "name": "network-vif-deleted", "tag": "11d25a6b-1022-43a4-824d-f35dc0c23dcc"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:16.527344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d125c043-0825-49ca-ae7e-57b2ad4df255 req-77f5aa5c-6929-4974-b057-cafe7fb745b8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.530295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d125c043-0825-49ca-ae7e-57b2ad4df255 req-77f5aa5c-6929-4974-b057-cafe7fb745b8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.543736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:16.546725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:16.561989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.563520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.566999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.567507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.578669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-d125c043-0825-49ca-ae7e-57b2ad4df255 req-77f5aa5c-6929-4974-b057-cafe7fb745b8 service nova] Creating event network-vif-deleted:11d25a6b-1022-43a4-824d-f35dc0c23dcc for instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 on hv-cinder-85069 Jul 21 22:35:16.607782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-d125c043-0825-49ca-ae7e-57b2ad4df255 req-77f5aa5c-6929-4974-b057-cafe7fb745b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106309 Jul 21 22:35:16.611621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 70/148] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:16.667209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:16.668228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:16.702403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.704154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.705434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:16.707862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:16.874707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:16.885602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6b33152f-76d5-4ea2-9ddc-c36806b16ea9 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1345 microversion: 2.1 time: 0.224360 Jul 21 22:35:16.889712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 71/149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:16 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:17.016939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:17.026256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c7622440-0c5e-4e7c-81f3-bf2d7d2cf07f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.502370 Jul 21 22:35:17.026846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 79/150] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:16 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:17.916112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:17.917434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:17.951377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:17.952106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:17.953085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:17.953522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.006276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.007061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.007994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lazy-loading 'fault' on Instance uuid f5b07743-4b75-4d9f-8230-5cc93fc5ed80 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:35:18.045719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:18.046853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:18.061226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.061528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.065432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:18.068676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:18.137240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c43bf6734c984c6e9d189660f903958b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa3208211a214b4a9c7face1a1fed6f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.150593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b81b593b-be6d-4246-aa88-dc2e899cc3da tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 200 len: 1304 microversion: 2.1 time: 0.242632 Jul 21 22:35:18.151439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 72/151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:17 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:18.577310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:18.622384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5719dc4-d13a-416e-9a1d-0f9046b4d9d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.581640 Jul 21 22:35:18.626290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 80/152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:18 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:19.191847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:19.192905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:19.210171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.211703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.215291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.216188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.246177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] HTTP exception thrown: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Request method failure captured: Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 HTTP/1.1 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRV9n2iX4Uf8WKtKP221RNNReNI3MKts1BquzuG9iEJigUCP_o5e9KmA6vQbypZY6CcjrqKXuz0ALEK4qRsFe2yDoWBq_Vuw4e-Vmt0BMDJloJYMkrTT3NQnCaQFvpe8mlVErHxJGG2muy7kQN1A1ScfOWf8LFuhKDED8JImloQpc0 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:35:19.256270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: c43bf6734c984c6e9d189660f903958b Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.260017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'f5b07743-4b75-4d9f-8230-5cc93fc5ed80'} Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:19.261410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.263622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.268131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Returning 404 to user: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:19.268131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2a87ee2-9124-4b33-8030-c444ed4e204c tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 404 len: 111 microversion: 2.1 time: 0.085310 Jul 21 22:35:19.268131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 73/153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:19 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:19.480382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:19.481778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:19.489701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.490721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.493227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.495163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.526992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] HTTP exception thrown: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Request method failure captured: Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80/os-volume_attachments HTTP/1.1 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRV9n2iX4Uf8WKtKP221RNNReNI3MKts1BquzuG9iEJigUCP_o5e9KmA6vQbypZY6CcjrqKXuz0ALEK4qRsFe2yDoWBq_Vuw4e-Vmt0BMDJloJYMkrTT3NQnCaQFvpe8mlVErHxJGG2muy7kQN1A1ScfOWf8LFuhKDED8JImloQpc0 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:19.554097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: c43bf6734c984c6e9d189660f903958b Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.557597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': 'f5b07743-4b75-4d9f-8230-5cc93fc5ed80'} Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:19.558763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:19.560898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:19.564406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Returning 404 to user: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:19.566418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ee82f04d-a8ad-461a-8635-5e79bde88373 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091398 Jul 21 22:35:19.569760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 81/154] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:35:19 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:19.653674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:19.654624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:19.684832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.686990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.687926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:19.692621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:19.998281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:20.008293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2d585ed4-52b3-4e03-a0ab-63d4d341cc73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.359873 Jul 21 22:35:20.010487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 74/155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:19 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:21.001065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:21.009773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:21.031518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.032712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.034078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.034815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.037595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:21.038380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:21.041245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:21.057274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.060348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.063239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.064311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.072213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] HTTP exception thrown: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Request method failure captured: Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 HTTP/1.1 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRV9n2iX4Uf8WKtKP221RNNReNI3MKts1BquzuG9iEJigUCP_o5e9KmA6vQbypZY6CcjrqKXuz0ALEK4qRsFe2yDoWBq_Vuw4e-Vmt0BMDJloJYMkrTT3NQnCaQFvpe8mlVErHxJGG2muy7kQN1A1ScfOWf8LFuhKDED8JImloQpc0 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:21.076970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: c43bf6734c984c6e9d189660f903958b Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.079606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'f5b07743-4b75-4d9f-8230-5cc93fc5ed80'} Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:21.083248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.085703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.088098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Returning 404 to user: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:21.088098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6b06504-b528-4f88-add7-857e88075722 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 404 len: 111 microversion: 2.1 time: 0.087710 Jul 21 22:35:21.088098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 82/156] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:35:20 2022] DELETE /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:21.096859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:21.097828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] [instance: f5b07743-4b75-4d9f-8230-5cc93fc5ed80] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:21.108167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.109062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.110308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:21.111401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:21.131157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] HTTP exception thrown: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Request method failure captured: Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 HTTP/1.1 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRV9n2iX4Uf8WKtKP221RNNReNI3MKts1BquzuG9iEJigUCP_o5e9KmA6vQbypZY6CcjrqKXuz0ALEK4qRsFe2yDoWBq_Vuw4e-Vmt0BMDJloJYMkrTT3NQnCaQFvpe8mlVErHxJGG2muy7kQN1A1ScfOWf8LFuhKDED8JImloQpc0 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:21.133380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/aa3208211a214b4a9c7face1a1fed6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: aa3208211a214b4a9c7face1a1fed6f0 Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-DeleteServersTestJSON-1332745547 Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: c43bf6734c984c6e9d189660f903958b Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-DeleteServersTestJSON-1332745547-project Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.134688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'f5b07743-4b75-4d9f-8230-5cc93fc5ed80'} Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:21.135384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. Jul 21 22:35:21.137775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:21.142089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] Returning 404 to user: Instance f5b07743-4b75-4d9f-8230-5cc93fc5ed80 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:21.143214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-748b774c-5caf-4437-bb6c-ea15815a01c0 tempest-DeleteServersTestJSON-1332745547 tempest-DeleteServersTestJSON-1332745547-project] 10.222.0.42 "GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80" status: 404 len: 111 microversion: 2.1 time: 0.055396 Jul 21 22:35:21.148156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 83/157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:21 2022] GET /compute/v2.1/servers/f5b07743-4b75-4d9f-8230-5cc93fc5ed80 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:21.509723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:21.521109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-07b4180b-8b7d-4e95-8609-64529a413ca2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.488045 Jul 21 22:35:21.521867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 75/158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:21 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:22.549952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:22.551780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:22.563250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:22.567275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:22.580398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:22.580398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:23.107903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:23.137371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7230e8b9-23b1-48d2-badf-16470c7873c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.590796 Jul 21 22:35:23.138540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 84/159] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:22 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:24.161779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:24.163741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:24.186441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:24.187992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:24.189789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:24.190700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:24.674801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:24.701814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-31d56cb3-8d3d-4692-9411-6f12ced91043 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.547744 Jul 21 22:35:24.703300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 76/160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:24 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:25.731972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:25.733439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:25.757683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:25.761364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:25.766438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:25.767244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:25.787481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=87 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:26.469675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:26.499872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ebb88cd-9e23-4bb1-b209-02ba9b2f9f9d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.774864 Jul 21 22:35:26.519568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 85/161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:25 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:27.531925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:27.536384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:27.568294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.569760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:27.576988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:27.578266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:28.159973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:28.191374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cd3db495-4908-43e9-ad6f-e6d107edaed0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.666192 Jul 21 22:35:28.197657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 77/162] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:27 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:29.225907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:29.228955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:29.239541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=34 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:29.266675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:29.267415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:29.268667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:29.273736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:29.953092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:29.989597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d6752097-3718-4481-bcdd-7cb2a0403d35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.768749 Jul 21 22:35:29.996524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 86/163] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:29 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:31.030336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:31.031699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:31.041988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:31.042573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:31.043925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:31.044549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:31.297694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:31.311049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-67bf43d9-2b6f-41ac-b7ce-d519abe4948d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.286716 Jul 21 22:35:31.318589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 78/164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:31 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:31.589362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1666695934", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "networks": [{"uuid": "06d8e8a5-0ff3-450d-bde5-3678047416be"}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:31.672712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] validate_networks() for [('06d8e8a5-0ff3-450d-bde5-3678047416be', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:35:32.308444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:35:32.310381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:35:32.312586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:35:32.314059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:35:32.315532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:35:32.330169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.346205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:32.348017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.350542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.350816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:32.354575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.378483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.378934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.379929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:32.380384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:32.409326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Getting quotas for project 58636dfe0f8c463bab0031b5d6734bd9. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:32.429005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Getting quotas for user 35f252f0338547aea73d1eb7c81ca199 and project 58636dfe0f8c463bab0031b5d6734bd9. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:32.487612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:35:32.493685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:35:32.612268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-23c45ed9-3828-4120-9ab0-80801ae41dc2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031754 Jul 21 22:35:32.613213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 87/165] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:35:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:35:32.804005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:32.827859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6aea44bf-d3f4-41db-84ad-79405849ea3c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.494308 Jul 21 22:35:32.840611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 79/166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:32 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:32.853595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b866af89-3278-4b67-bab6-d97f1d60740f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:32.855417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b866af89-3278-4b67-bab6-d97f1d60740f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:32.909696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dad17ca5-164b-45da-b2a6-3a0a68eeb404 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Action: 'create', calling method: .version_select at 0x7ff1d94c5e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1448678010"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:32.969669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b866af89-3278-4b67-bab6-d97f1d60740f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:32.981259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b866af89-3278-4b67-bab6-d97f1d60740f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1214 microversion: 2.1 time: 0.137505 Jul 21 22:35:32.982622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 80/167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:32 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:33.392891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dad17ca5-164b-45da-b2a6-3a0a68eeb404 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.777458 Jul 21 22:35:33.406955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 88/168] 10.222.0.42 () {60 vars in 1154 bytes} [Thu Jul 21 22:35:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 781 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 22:35:33.429375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-54cd80aa-8917-4890-8460-f0cce41d222a tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8d8ec10>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:33.504026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-54cd80aa-8917-4890-8460-f0cce41d222a tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 200 len: 345 microversion: 2.1 time: 0.089543 Jul 21 22:35:33.504662 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 81/169] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:35:33 2022] GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:33.868494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:33.870232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:33.882789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:33.883745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:33.885217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:33.886057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.019611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.020722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:34.034269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.036394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.040778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:34.042287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:34.198593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:34.201580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:34.216422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-adf93a1b-7bc0-4714-9c2c-a2b7a9a9f69b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1266 microversion: 2.1 time: 0.204177 Jul 21 22:35:34.217758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:34.218204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b603a492-2d9b-4030-a4c9-a11a2f1369af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1521 microversion: 2.1 time: 0.363364 Jul 21 22:35:34.218934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 89/171] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:33 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:34.517578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6398d5fe-9f84-4341-b442-38a278b4ea32 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8c0f040>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.572425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6398d5fe-9f84-4341-b442-38a278b4ea32 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 200 len: 346 microversion: 2.1 time: 0.058665 Jul 21 22:35:34.573065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 83/172] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:34.593228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ee01b5d-6f08-460a-ae64-54cf5e73841d tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Action: 'create', calling method: .version_select at 0x7ff1d94c7670>, body: {"snapshot": {"volume_id": "3db85837-529a-40a0-a111-1bc21fc8059a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-369382317"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:34.860864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ee01b5d-6f08-460a-ae64-54cf5e73841d tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.273564 Jul 21 22:35:34.862269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 90/173] 10.222.0.42 () {60 vars in 1161 bytes} [Thu Jul 21 22:35:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:34.876697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-05520522-cf82-4e4d-9c25-a831c32843c0 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8c98280>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.933894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-05520522-cf82-4e4d-9c25-a831c32843c0 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.061952 Jul 21 22:35:34.934566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:34.951017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4158e460-cd4b-4428-99a3-4d26eedba2d3 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c50d0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:34.997894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4158e460-cd4b-4428-99a3-4d26eedba2d3 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.053415 Jul 21 22:35:34.998587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jul 21 22:35:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:35.014291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee459d7d-e5d7-48c1-8926-7bafc0400b74 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8afee50>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:35.081811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee459d7d-e5d7-48c1-8926-7bafc0400b74 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.064595 Jul 21 22:35:35.081811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:35 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:35.234938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:35.235564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:35.237228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:35.237901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:35.245514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.245955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.246432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.246798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.247258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.247684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.249444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.250101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.327915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.337401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-273822f1-9516-4e29-97b6-ca367a64def0 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1272 microversion: 2.1 time: 0.105811 Jul 21 22:35:35.338511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 92/177] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:35 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:35.453754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.461927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de105f59-649e-4855-8e04-e1caa2c4d762 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1501 microversion: 2.1 time: 0.228827 Jul 21 22:35:35.462514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:35 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:35.485177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:35.486931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:35.498389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.499115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.500498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:35.501097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:35.670862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:35.678836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-65e9471d-dd29-4933-8eea-356819825b3f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1515 microversion: 2.1 time: 0.199078 Jul 21 22:35:35.679415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 93/179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:35 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:36.089015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7290f3a7-5351-4a97-b5f8-2dc5006077c9 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8d8e3a0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:36.120853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7290f3a7-5351-4a97-b5f8-2dc5006077c9 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.035835 Jul 21 22:35:36.121431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:36 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:36.364606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:36.365259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:36.373190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.373639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.374621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:36.375056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:36.447433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:36.455380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46e000fc-2598-437a-a264-9af4c7ff0acc tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1272 microversion: 2.1 time: 0.094818 Jul 21 22:35:36.455964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 94/181] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:36 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:37.133628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e8da510b-8c68-4bc3-8028-a6776ec4d08e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8afe8b0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:37.163669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e8da510b-8c68-4bc3-8028-a6776ec4d08e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.034787 Jul 21 22:35:37.164902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 88/182] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:37 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:37.473628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:37.474352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:37.482585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.483027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.483802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:37.484242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:37.558068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:37.566918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-adc39498-a049-4549-b79f-a7d6ce6434c4 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1272 microversion: 2.1 time: 0.097243 Jul 21 22:35:37.567582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 95/183] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:37 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:38.177392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7cdffff6-fc46-45c1-894e-9369db2e6052 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8c31f70>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:38.211852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7cdffff6-fc46-45c1-894e-9369db2e6052 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.039072 Jul 21 22:35:38.212695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:38 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:38.586270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:38.587387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:38.593464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.593930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.594723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:38.595156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:38.770642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:38.781083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-57371526-839a-436c-87ae-47cebed6bd01 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.199189 Jul 21 22:35:38.781950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 96/185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:38 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:39.228753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-21c44abf-bff4-49e9-aee1-e8e2e06761bd tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c55e0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.248090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:39.251862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.268249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-21c44abf-bff4-49e9-aee1-e8e2e06761bd tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 287 microversion: 2.1 time: 0.044804 Jul 21 22:35:39.269353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 97/186] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:39.280471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f898960-c383-4e39-b1fc-45ff69df67b7 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c78b0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.292678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.293749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.295033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.295684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.330882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lazy-loading 'flavor' on Instance uuid 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:35:39.353567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:39.384920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f898960-c383-4e39-b1fc-45ff69df67b7 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 202 len: 0 microversion: 2.1 time: 0.108528 Jul 21 22:35:39.386281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 98/187] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jul 21 22:35:39 2022] DELETE /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:35:39.395219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3253e29e-398f-4ebf-9f37-3fcad516a440 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c7670>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.461723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b7450457-c4fe-4009-b8bd-e4aaa0efe02f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/action" status: 200 len: 32 microversion: 2.1 time: 0.241111 Jul 21 22:35:39.470329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 90/188] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:35:39 2022] POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/action => generated 32 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:35:39.496028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.498822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.512742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3253e29e-398f-4ebf-9f37-3fcad516a440 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 200 len: 286 microversion: 2.1 time: 0.121901 Jul 21 22:35:39.513161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.513375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 99/189] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:39.519748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.521347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.521811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.804347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:39.806158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:39.817458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.818608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.821412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:39.823531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:39.913891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:39.927565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63769ccd-2950-4c72-8ac3-99ea7a17e9cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.455567 Jul 21 22:35:39.928453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 91/190] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:40.049854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:40.054186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-d40b0e61-9b34-486c-8b68-121362177cc0 req-84eaf24f-ec6a-4d43-9d54-e0b64dfa25aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93a1114-108e-479a-8ce4-059a1100191c", "tag": "a6df3642-2fe6-4e73-b44a-5a164d721daf"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:40.060786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08dfe557-a0c3-4148-998b-50882b3cbb0f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.264073 Jul 21 22:35:40.065109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d40b0e61-9b34-486c-8b68-121362177cc0 req-84eaf24f-ec6a-4d43-9d54-e0b64dfa25aa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.065661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d40b0e61-9b34-486c-8b68-121362177cc0 req-84eaf24f-ec6a-4d43-9d54-e0b64dfa25aa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.072261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 100/191] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:39 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:40.080985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-d40b0e61-9b34-486c-8b68-121362177cc0 req-84eaf24f-ec6a-4d43-9d54-e0b64dfa25aa service nova] Creating event network-changed:a6df3642-2fe6-4e73-b44a-5a164d721daf for instance d93a1114-108e-479a-8ce4-059a1100191c on hv-cinder-85069 Jul 21 22:35:40.086928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-d40b0e61-9b34-486c-8b68-121362177cc0 req-84eaf24f-ec6a-4d43-9d54-e0b64dfa25aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035398 Jul 21 22:35:40.087967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 92/192] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:40.527580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2b81132-d3b7-4342-bb9a-ac6c0eb5249c tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c5e50>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.553589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-a2b81132-d3b7-4342-bb9a-ac6c0eb5249c tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] HTTP exception thrown: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2b81132-d3b7-4342-bb9a-ac6c0eb5249c tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Request method failure captured: Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 HTTP/1.1 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dS05RcS-VxzzHQgP-1QtJaMsWzEn_yBudiZYcNJTTZ2GEeibF4t3p06JCrz2xuHvPhvns9lfI7BTFQYxw4KtJbuHat3sBKmrMIZrK38AtpcQNhvkwrQp2gw0T5AI01uVE-iOR4nkjnaWy_Lu2DLs4R4W87tVrScL8WVJ3LgA-XYh90 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:40.556784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_78240e67d1eb4161a80b2473a50011af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b29cfabbbf7d4c28a983bd1c740dbed4 Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '1e874541-dd84-477e-a1b3-ffa843316587'} Jul 21 22:35:40.558284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. (HTTP 404) (Request-ID: req-814cd983-02f4-4b43-b34e-ad2c3c544a1d) Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.559132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:40.560735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 22:35:40.561788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2b81132-d3b7-4342-bb9a-ac6c0eb5249c tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Returning 404 to user: Snapshot 1e874541-dd84-477e-a1b3-ffa843316587 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:40.562890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a2b81132-d3b7-4342-bb9a-ac6c0eb5249c tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587" status: 404 len: 111 microversion: 2.1 time: 0.035128 Jul 21 22:35:40.563657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 101/193] 10.222.0.42 () {58 vars in 1250 bytes} [Thu Jul 21 22:35:40 2022] GET /compute/v2.1/os-snapshots/1e874541-dd84-477e-a1b3-ffa843316587 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:40.570216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c057f6ce-01d3-45b4-950e-ddd3ea872821 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d9f12790>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.663887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c057f6ce-01d3-45b4-950e-ddd3ea872821 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 202 len: 0 microversion: 2.1 time: 0.098071 Jul 21 22:35:40.664498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 93/194] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 22:35:40 2022] DELETE /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:35:40.677652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a46b5312-8b57-4313-90d1-11d66f9b23b3 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d946e1f0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.783542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a46b5312-8b57-4313-90d1-11d66f9b23b3 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 200 len: 345 microversion: 2.1 time: 0.113145 Jul 21 22:35:40.785551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 102/195] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:35:40 2022] GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:40.952856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:40.954560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:40.968163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.968707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:40.969518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:40.969965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.079354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.080133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:41.087338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.087883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.088773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.089272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.237918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:41.253817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3b8026db-ddbe-4826-9a66-4c0cf1c2541a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.310441 Jul 21 22:35:41.254601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 94/196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:40 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:41.333971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:41.342700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32c769a6-1704-46f2-a92a-df15a2eaeece tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.267380 Jul 21 22:35:41.343318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 103/197] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:41.474642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.475632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:41.486312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.487205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.488693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:41.489520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:41.518608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aca31985-bdcd-4983-bd90-3fe84591949b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/ips" status: 200 len: 152 microversion: 2.20 time: 0.050443 Jul 21 22:35:41.519308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 95/198] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:35:41.799202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3b12930-5f88-4bc4-9393-dbb51e8b54de tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d946e700>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.832034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-d3b12930-5f88-4bc4-9393-dbb51e8b54de tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] HTTP exception thrown: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3b12930-5f88-4bc4-9393-dbb51e8b54de tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Request method failure captured: Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a HTTP/1.1 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dS05RcS-VxzzHQgP-1QtJaMsWzEn_yBudiZYcNJTTZ2GEeibF4t3p06JCrz2xuHvPhvns9lfI7BTFQYxw4KtJbuHat3sBKmrMIZrK38AtpcQNhvkwrQp2gw0T5AI01uVE-iOR4nkjnaWy_Lu2DLs4R4W87tVrScL8WVJ3LgA-XYh90 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:41.835449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_78240e67d1eb4161a80b2473a50011af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b29cfabbbf7d4c28a983bd1c740dbed4 Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '3db85837-529a-40a0-a111-1bc21fc8059a'} Jul 21 22:35:41.837327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. (HTTP 404) (Request-ID: req-4a34d744-c3b0-49df-b397-e53af2f5b420) Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.838219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:41.839482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:35:41.840732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3b12930-5f88-4bc4-9393-dbb51e8b54de tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Returning 404 to user: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d3b12930-5f88-4bc4-9393-dbb51e8b54de tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 404 len: 109 microversion: 2.1 time: 0.042328 Jul 21 22:35:41.841983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 104/199] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:41.863661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-053e63ba-b75b-43aa-8808-50c1e95f5012 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d8afee50>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.902378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-053e63ba-b75b-43aa-8808-50c1e95f5012 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] HTTP exception thrown: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-053e63ba-b75b-43aa-8808-50c1e95f5012 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Request method failure captured: Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a HTTP/1.1 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dS05RcS-VxzzHQgP-1QtJaMsWzEn_yBudiZYcNJTTZ2GEeibF4t3p06JCrz2xuHvPhvns9lfI7BTFQYxw4KtJbuHat3sBKmrMIZrK38AtpcQNhvkwrQp2gw0T5AI01uVE-iOR4nkjnaWy_Lu2DLs4R4W87tVrScL8WVJ3LgA-XYh90 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:35:41.904624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_78240e67d1eb4161a80b2473a50011af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: b29cfabbbf7d4c28a983bd1c740dbed4 Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '3db85837-529a-40a0-a111-1bc21fc8059a'} Jul 21 22:35:41.906000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. (HTTP 404) (Request-ID: req-6cef0f35-66fa-4e99-8450-010284759964) Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.906889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:35:41.908125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:35:41.909259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-053e63ba-b75b-43aa-8808-50c1e95f5012 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Returning 404 to user: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-053e63ba-b75b-43aa-8808-50c1e95f5012 tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 404 len: 109 microversion: 2.1 time: 0.051809 Jul 21 22:35:41.910468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 96/200] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 22:35:41 2022] DELETE /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:41.920974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1bed29ff-69bd-4c6c-b099-6540bd5d188e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Calling method '.version_select at 0x7ff1d94c51f0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:41.959823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-1bed29ff-69bd-4c6c-b099-6540bd5d188e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] HTTP exception thrown: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1bed29ff-69bd-4c6c-b099-6540bd5d188e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Request method failure captured: Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a HTTP/1.1 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dS05RcS-VxzzHQgP-1QtJaMsWzEn_yBudiZYcNJTTZ2GEeibF4t3p06JCrz2xuHvPhvns9lfI7BTFQYxw4KtJbuHat3sBKmrMIZrK38AtpcQNhvkwrQp2gw0T5AI01uVE-iOR4nkjnaWy_Lu2DLs4R4W87tVrScL8WVJ3LgA-XYh90 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:41.966190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_78240e67d1eb4161a80b2473a50011af"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/78240e67d1eb4161a80b2473a50011af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 78240e67d1eb4161a80b2473a50011af Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334305680 Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b29cfabbbf7d4c28a983bd1c740dbed4 Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334305680-project Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '3db85837-529a-40a0-a111-1bc21fc8059a'} Jul 21 22:35:41.977453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. (HTTP 404) (Request-ID: req-7ca728f3-4569-4244-b2fc-0058b7df6f45) Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.980077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:35:41.982288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:35:41.986911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1bed29ff-69bd-4c6c-b099-6540bd5d188e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] Returning 404 to user: Volume 3db85837-529a-40a0-a111-1bc21fc8059a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1bed29ff-69bd-4c6c-b099-6540bd5d188e tempest-VolumesSnapshotsTestJSON-1334305680 tempest-VolumesSnapshotsTestJSON-1334305680-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a" status: 404 len: 109 microversion: 2.1 time: 0.052379 Jul 21 22:35:41.990556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 105/201] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 22:35:41 2022] GET /compute/v2.1/os-volumes/3db85837-529a-40a0-a111-1bc21fc8059a => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:42.283639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:42.285218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:42.296497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.296997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.298245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.299052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.366009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:42.372750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:42.387196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:42.391542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.396163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.398411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:42.399271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:42.466459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:42.545246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.576403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-490eef96-c1ac-496b-abdd-659b693dc66a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.295859 Jul 21 22:35:42.581675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 97/202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:42 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:42.712387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:42.731597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc13c7a7-8667-4d12-92d4-034327552f1f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.375149 Jul 21 22:35:42.733628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 106/203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:42 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:43.597791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:43.598416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.601164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:43.612421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.613304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.614335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.614932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.760678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:43.762728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.778208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.779014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.779935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.780625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.886841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:43.903650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7a7f6bb9-ae4a-4efa-a96e-7647c3daac30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.309438 Jul 21 22:35:43.905835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 98/204] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:43 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:43.923604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:43.924358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:43.938073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.938635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.939556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:43.940163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:43.984632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lazy-loading 'flavor' on Instance uuid eba1ec2e-bdda-4057-8958-97def6b80299 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:35:44.066126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.074799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4ade247c-18e1-41f7-9dac-ca3eb0b47830 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.327747 Jul 21 22:35:44.076347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 107/205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:43 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:44.324805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2d419bf-551a-4f7b-8d61-016e1910e271 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action" status: 202 len: 0 microversion: 2.20 time: 0.416873 Jul 21 22:35:44.325450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 99/206] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 22:35:43 2022] POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:35:44.335593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:44.337240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:44.345130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.345673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.346657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.347433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.531643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.559260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.561405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:44.562693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f06e7261-c276-4537-a4b6-bc62c406a3ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.232406 Jul 21 22:35:44.563355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 108/207] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:44.937928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:44.939210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:44.952037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.953310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:44.954989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:44.955920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.096319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:45.098062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:45.111188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.112051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.113709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.114418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.163572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.180788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5897640d-404d-4356-9720-42b0dfc5af0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.251862 Jul 21 22:35:45.182190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 100/208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:44 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:45.293538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.302003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bace66f2-3bc4-435a-85a2-01081dacc448 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.211796 Jul 21 22:35:45.303182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 109/209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:45 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:45.597042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:45.599709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:45.625078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.626047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.627489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:45.628270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:45.945826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.965149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.971321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:45.973766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8603cd69-9e34-4702-a701-d9a6060ec1eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.392471 Jul 21 22:35:45.975512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 101/210] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:46.208942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:46.210314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:46.217658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.218467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.219311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.219807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.322483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:46.323120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:46.329794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.330242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.331021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.331671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.436048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:46.446166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e27dbd3e-bdb3-4df2-85e2-c1df01173563 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.240111 Jul 21 22:35:46.448026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 110/211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:46 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:46.510607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:46.519276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8fa34560-490b-4a1e-a291-560bb8d0c455 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.202174 Jul 21 22:35:46.520003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 102/212] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:46 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:46.836122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-e9dbdc08-1ce2-4108-8096-76d59146ae87 req-9ec4b09d-fdaf-406d-a69a-aae23de0c3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a1114-108e-479a-8ce4-059a1100191c", "name": "network-vif-plugged", "status": "completed", "tag": "a6df3642-2fe6-4e73-b44a-5a164d721daf"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:46.850871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-e9dbdc08-1ce2-4108-8096-76d59146ae87 req-9ec4b09d-fdaf-406d-a69a-aae23de0c3df service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:46.854749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-e9dbdc08-1ce2-4108-8096-76d59146ae87 req-9ec4b09d-fdaf-406d-a69a-aae23de0c3df service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:46.882894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-e9dbdc08-1ce2-4108-8096-76d59146ae87 req-9ec4b09d-fdaf-406d-a69a-aae23de0c3df service nova] Creating event network-vif-plugged:a6df3642-2fe6-4e73-b44a-5a164d721daf for instance d93a1114-108e-479a-8ce4-059a1100191c on hv-cinder-85069 Jul 21 22:35:46.889819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-e9dbdc08-1ce2-4108-8096-76d59146ae87 req-9ec4b09d-fdaf-406d-a69a-aae23de0c3df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057330 Jul 21 22:35:46.891194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 111/213] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:47.000129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.008588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.019459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.020232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.033865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.034388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.323439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.344415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.349016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.352638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-92c7afd5-d875-4560-97e7-6aca8cd78210 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.359391 Jul 21 22:35:47.353773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 103/214] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:47.467968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.468809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.488962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.490000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.490967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.491590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.541240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:47.542049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:47.551961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.556864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.557934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:47.558554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:47.656348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.667314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5e7cdbaf-c278-41bc-8f14-f2fa793c117e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.205389 Jul 21 22:35:47.678272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:47 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:47.793147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:47.801268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f64c4465-0100-4631-a932-e8f9ed850cdb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.266186 Jul 21 22:35:47.801844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 104/216] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:47 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:48.388193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.389827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.419869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.420913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.422435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.423464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.428990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:48.674797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.688856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.689776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.690586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.692444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.693818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9f60a45-aacd-4255-8aa0-b8f5891cb770 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.315619 Jul 21 22:35:48.694913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 113/217] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:48.713248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.713842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.715429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.716447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.824857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:48.825911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:48.855974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.860392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.861901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:48.871902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:48.931577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:48.950736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-725200ec-196f-41e3-ac42-d952b929f7dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.267866 Jul 21 22:35:48.951337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 105/218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:49.186590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.204659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ebf0529-71ef-4e8f-b5c9-462baac27ccf tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1314 microversion: 2.1 time: 0.386070 Jul 21 22:35:49.205606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 114/219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:48 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:49.719773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:49.720822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:49.728252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.728893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.730036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.730484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.946409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.955366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:49.968042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.969895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:49.971447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9981f6e-ac1e-48f7-b0b8-d6b0c0f3c393 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.255517 Jul 21 22:35:49.972384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 106/220] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:49.977766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:49.978922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:49.984621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.985060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:49.985824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:49.986254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.162712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.171430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-88a8c880-d08b-4fd4-b2f3-828dddc961d2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.198976 Jul 21 22:35:50.172001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 115/221] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:49 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:50.233437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:50.234081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:50.243244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.243798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.244985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:50.245584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:50.457392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:50.468708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9ab2d6d9-120e-451d-b048-1050f4dfedbb tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1498 microversion: 2.1 time: 0.238991 Jul 21 22:35:50.481197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 107/222] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:50 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1498 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:50.997279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:50.997279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.001853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.002307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.003087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.003710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.189287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.189929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.192460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=50 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:51.198749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.199194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.200223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.200721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.284154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.333122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.342854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.350454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc130413-d50e-44c6-9b39-a25e427f88b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.362940 Jul 21 22:35:51.353482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 116/223] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:51.413882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.415032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.421790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.422236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.423021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.423452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.466595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:35:51.467120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.476337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9ea18da-d694-4e74-b606-a282d7d17763 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.290732 Jul 21 22:35:51.486923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 108/224] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:51 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:51.654375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-541e8154-bb33-4d56-91d9-339c4c76a1e8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 204 len: 0 microversion: 2.1 time: 0.245826 Jul 21 22:35:51.655765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 117/225] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:35:51 2022] DELETE /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:35:51.670935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:51.673108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:51.685413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.686373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.687850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:51.688432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:51.880725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:51.890497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-122dddfd-9cae-4e3b-a862-177b667acc48 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1504 microversion: 2.1 time: 0.229127 Jul 21 22:35:51.891509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 109/226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:51 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:52.377483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:52.378324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:52.391672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.392201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.393447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.394227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.499650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:52.501991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:52.513680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.514486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.515887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.516728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.565165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.575652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.577198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.578410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-87e21915-bc57-4be1-98d3-c117723ca2f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.207217 Jul 21 22:35:52.579131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 118/227] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:52.676312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:52.689133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b9acabe4-6e14-40ea-83ab-422719e92164 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.197048 Jul 21 22:35:52.689729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 110/228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:52 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:52.912748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:52.914803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:52.926992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.928256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:52.930420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:52.931393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.177580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.192333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8827ced2-4b32-4366-969e-034b0da5bc8f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1504 microversion: 2.1 time: 0.285933 Jul 21 22:35:53.193279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 119/229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:52 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:53.598026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:53.598899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:53.605732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.606182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.606945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.607550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.721156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:53.723553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:53.738264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.739205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.740969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:53.742739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:53.972134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:53.986004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fb6f6149-3226-4a8f-9f98-ec11e8ed95ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.273381 Jul 21 22:35:53.996893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 120/230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:53 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:54.005003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.016397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.018779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.020574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c571d015-bd82-48d2-99eb-6a618510c9ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.426702 Jul 21 22:35:54.021373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 111/231] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:54.229963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:54.231454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:54.238296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.240630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.242754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.243362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.297617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-0cfa9d58-3c20-4ae5-8c1e-73eee4d59141 req-0e400d4d-96ff-4298-8f13-e24a01eead70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93a1114-108e-479a-8ce4-059a1100191c", "name": "network-vif-deleted", "tag": "a6df3642-2fe6-4e73-b44a-5a164d721daf"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:54.309989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-0cfa9d58-3c20-4ae5-8c1e-73eee4d59141 req-0e400d4d-96ff-4298-8f13-e24a01eead70 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:54.310713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-0cfa9d58-3c20-4ae5-8c1e-73eee4d59141 req-0e400d4d-96ff-4298-8f13-e24a01eead70 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:54.324948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-0cfa9d58-3c20-4ae5-8c1e-73eee4d59141 req-0e400d4d-96ff-4298-8f13-e24a01eead70 service nova] Creating event network-vif-deleted:a6df3642-2fe6-4e73-b44a-5a164d721daf for instance d93a1114-108e-479a-8ce4-059a1100191c on hv-cinder-85069 Jul 21 22:35:54.331579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-0cfa9d58-3c20-4ae5-8c1e-73eee4d59141 req-0e400d4d-96ff-4298-8f13-e24a01eead70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036819 Jul 21 22:35:54.334476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 112/232] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:35:54.362092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:54.388365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4a1ca0b1-699d-4ae8-a05a-03f218e9f64d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 200 len: 1462 microversion: 2.1 time: 0.157270 Jul 21 22:35:54.389064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 121/233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:54 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 1462 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:55.005834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:55.009687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:55.018682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.019281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.020312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.021095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.040848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:55.041531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:55.056698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.057586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.058677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.059456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.270574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.278083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.285047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.286742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:55.288152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-04de3cf8-843e-4a91-b09b-70fcdd797c1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.252666 Jul 21 22:35:55.289738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 122/234] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:55.302505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8a34dac-912b-424e-bdcd-ccd1661287c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.288609 Jul 21 22:35:55.303432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 113/235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:54 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:55.406789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:55.408534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: d93a1114-108e-479a-8ce4-059a1100191c] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:55.418750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.424014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.424992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:55.425977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:55.443027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] HTTP exception thrown: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Request method failure captured: Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c HTTP/1.1 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dSwCsavq4X3Qo9nBoa-h5oz0_ruTEWfsGS77zIhiMHsrROkHIA70bepHJwVQhEWgW-N4RLZmeBU6wHFogG24nPwB6Gj3lJZtINquXXj0OlmKqw7GFrlU8-uJT2SFC8crtUCBx1rNr2AsGZN9FXBVk_LG87kjALkOx7o5CwsZF2vb00 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 58636dfe0f8c463bab0031b5d6734bd9 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesActionsTest-1231401178 Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:35:55.445502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesActionsTest-1231401178 Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 58636dfe0f8c463bab0031b5d6734bd9 Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesActionsTest-1231401178 Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesActionsTest-1231401178-project Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 35f252f0338547aea73d1eb7c81ca199 Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesActionsTest-1231401178-project Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. Jul 21 22:35:55.447177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'd93a1114-108e-479a-8ce4-059a1100191c'} Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:35:55.448153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. Jul 21 22:35:55.463195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:35:55.464277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Returning 404 to user: Instance d93a1114-108e-479a-8ce4-059a1100191c could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:35:55.464277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-98268ab6-da53-4142-910e-7dae684905ec tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c" status: 404 len: 111 microversion: 2.1 time: 0.050518 Jul 21 22:35:55.464277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 123/236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:55 2022] GET /compute/v2.1/servers/d93a1114-108e-479a-8ce4-059a1100191c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:55.594461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2095161649", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "networks": [{"uuid": "06d8e8a5-0ff3-450d-bde5-3678047416be"}]}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:55.668937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] validate_networks() for [('06d8e8a5-0ff3-450d-bde5-3678047416be', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:35:56.159985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:35:56.161360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:35:56.162150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:35:56.163058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:35:56.164782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:35:56.178325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.180079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.181073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.181635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.205928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Getting quotas for project 58636dfe0f8c463bab0031b5d6734bd9. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:56.214044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Getting quotas for user 35f252f0338547aea73d1eb7c81ca199 and project 58636dfe0f8c463bab0031b5d6734bd9. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:56.223389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:35:56.225732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:35:56.281953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-008a4920-ba3d-4818-bad5-230d9bd4fac8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691597 Jul 21 22:35:56.283170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 114/237] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:35:56.299187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-15b84b79-1b50-477f-81b0-88521275fa22 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.299781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-15b84b79-1b50-477f-81b0-88521275fa22 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.308659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.311042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.334790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.336729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.341864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.342710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.414109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-15b84b79-1b50-477f-81b0-88521275fa22 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.427030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-15b84b79-1b50-477f-81b0-88521275fa22 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1214 microversion: 2.1 time: 0.136740 Jul 21 22:35:56.427848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 124/238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:56.435615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:56.438345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:56.446813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.447794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.449333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:56.450002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:56.594379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.622088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.626199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.627628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b3773a22-67e4-42c7-9929-a6adba324b67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.324751 Jul 21 22:35:56.629827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 115/239] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:35:56.749116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:56.770048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cc960c25-f686-4cdc-9136-7d9b94e8fb91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.338655 Jul 21 22:35:56.771121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 125/240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:56 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:57.451903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:57.452667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:57.460611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.461375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.461848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.462579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.534790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.548837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-40c89eb5-0cac-44e8-8fa6-1f4f614e795c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1266 microversion: 2.1 time: 0.102003 Jul 21 22:35:57.550487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 116/241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:57 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:57.679231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:57.680358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:57.691566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.692289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.694198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.695585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.796463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:57.797575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:57.813483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.814412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.815465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:57.816337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:57.931853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.949204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.951230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:57.952797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9e6ab33-e26f-46f8-bd3d-e0e7bb0b89ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.283453 Jul 21 22:35:57.965375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 126/242] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:58.377209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.386340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-999a71e0-5120-41fb-8eb5-434e04bd1996 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.594095 Jul 21 22:35:58.396067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 117/243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:57 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:35:58.572854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:58.573651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:58.582681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:58.583795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.584753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:58.587486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:58.713127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:58.723969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3dd1a3fe-4ce4-477e-82be-4b6524688ae2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1272 microversion: 2.1 time: 0.158045 Jul 21 22:35:58.727614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 127/244] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:58 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:35:58.977259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:58.979434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.009168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.010430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.012463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.013560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.407341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.410146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.415945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:59.424199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.425170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.426436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.427112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.440929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.457228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.460810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.463192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f3e30bf7-58bc-4d50-8086-51a7eb4a2221 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.493623 Jul 21 22:35:59.478361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 118/245] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:35:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:35:59.747478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:35:59.748497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:35:59.758239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.759065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.759895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:35:59.760551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:35:59.777858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:35:59.787714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b35b45b4-cf3d-4167-b8f9-ecefd7320671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.386709 Jul 21 22:35:59.798780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 128/246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:00.030841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:00.057541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a4c3b990-1988-4bd1-b033-38a4841c2ff8 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.314719 Jul 21 22:36:00.059856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 119/247] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:35:59 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:00.362254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-a95d2133-9187-4ba2-a06c-586cc92c44b4 req-19c24bd5-bd85-45e2-995d-2795eaea651c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c66088c-2251-47b8-98ef-ce8cc008be9a", "tag": "65671c0b-fd32-4d40-abe7-87f96b642d6c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:00.393500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-a95d2133-9187-4ba2-a06c-586cc92c44b4 req-19c24bd5-bd85-45e2-995d-2795eaea651c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.394311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-a95d2133-9187-4ba2-a06c-586cc92c44b4 req-19c24bd5-bd85-45e2-995d-2795eaea651c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.417506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-a95d2133-9187-4ba2-a06c-586cc92c44b4 req-19c24bd5-bd85-45e2-995d-2795eaea651c service nova] Creating event network-changed:65671c0b-fd32-4d40-abe7-87f96b642d6c for instance 1c66088c-2251-47b8-98ef-ce8cc008be9a on hv-cinder-85069 Jul 21 22:36:00.427275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-a95d2133-9187-4ba2-a06c-586cc92c44b4 req-19c24bd5-bd85-45e2-995d-2795eaea651c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071851 Jul 21 22:36:00.429126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 129/248] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:00.500098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:00.500969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:00.511894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.512377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.513217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.513658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.784822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:00.798706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:00.801621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:00.803213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e8d71d09-27cd-45a2-884c-f34a70b3e220 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.309665 Jul 21 22:36:00.804929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 120/249] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:00.810699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:00.811745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:00.823412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.824932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.827066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:00.828083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:00.859283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:01.068204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.082839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:01.083837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:01.088833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37f45e7c-faba-4e3d-a4bd-8f9d6b8d10c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.285623 Jul 21 22:36:01.091113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 130/250] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:00 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:01.105610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.105610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:01.105610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.105610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:01.342848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:01.359438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5eebc3ba-a057-47ac-a987-4546e3446a2f tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.287024 Jul 21 22:36:01.376933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 121/251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:01 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:01.826697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:01.827654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:01.837118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.837819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:01.839017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:01.839551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.126151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.129270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:02.130596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:02.144730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.149010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.151154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-26e6b09f-7ae6-435b-a02a-fd76dc5b494f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.330269 Jul 21 22:36:02.152651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 131/252] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:02.154799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.155697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.157462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.158572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.389149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:02.390143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:02.403373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.403820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.404656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:02.405093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:02.642703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.655187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a685fbc5-b73b-4b4c-9721-0c039e4d30fe tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.539859 Jul 21 22:36:02.660676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:02.661085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 122/253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:02 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:02.669053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a8b46dd4-ea1e-4292-b0a0-94092799b127 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.283603 Jul 21 22:36:02.669654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 132/254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:02 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:03.172339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:03.173843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:03.185013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.185821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.187205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.188778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.430885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.440887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.445952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.447189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4c0c3140-d55d-428e-8589-e4b399325109 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.280812 Jul 21 22:36:03.447767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 123/255] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:03.675727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:03.676803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:03.690712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:03.692720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:03.705062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.707135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.708866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.710164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.723660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.724676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.729426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:03.735419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:03.896036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.914450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c881b07a-85f1-4b79-906f-bdcc620ea802 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.245822 Jul 21 22:36:03.915044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 133/256] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:03 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:03.947187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:03.951451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:03.956376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a9dc27d9-e5b6-49d3-94a3-6b797414b285 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.273164 Jul 21 22:36:03.956985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 124/257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:03 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:04.473047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:04.473561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:04.481298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.481754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.482534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.482992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.638951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.649099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.650867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:04.652090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c1c38f91-2496-4e36-b607-0c74cbf00bae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1724 microversion: 2.20 time: 0.183017 Jul 21 22:36:04.652682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 134/258] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:04.932586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:04.933305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:04.940706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.941279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.942165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.942795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.973564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:04.974942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:04.984649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.985449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:04.986397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:04.987036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:05.141639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:05.145563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:05.151650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-65e7f5f4-12fd-4be2-bf07-3fb9728d73b2 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.181917 Jul 21 22:36:05.152233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 135/259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:04 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:05.154338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-37eb56ac-89e7-4b3a-a26c-eb8c78321631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.226520 Jul 21 22:36:05.155018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 125/260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:04 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:05.671760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:05.672053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:05.684534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:05.685040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:05.686057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:05.687256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:05.875564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:05.886337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:05.888742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:05.891090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-745a00da-6c3b-401f-933c-64bf6b9bb379 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.224091 Jul 21 22:36:05.891832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 136/261] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:06.172796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.173679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.180218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.182917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.183580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.184534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.184756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.185307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.190952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:06.199635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.200304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.201968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.203307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.223803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:06.357276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.373553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b59f9231-39f0-4f44-a1d2-ee493f8e6c2c tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.204931 Jul 21 22:36:06.377797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 126/262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:06 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:06.408044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.417561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-895e018e-b733-4eb2-bbad-3fe1decb2d4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1501 microversion: 2.1 time: 0.247070 Jul 21 22:36:06.426127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 137/263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:06 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:06.439885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eea4a7e8-f530-461c-96b3-72da96e66b41"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:06.441476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.449454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.449988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.451185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.451979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.484590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] HTTP exception thrown: Cannot 'attach_volume' instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 while it is in vm_state rescued Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Request method failure captured: Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/os-volume_attachments HTTP/1.1 Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 74 Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRa1aevr8hfzH9tBnuI-nZ1o2-tjU0GUNavGBtGQWU6Bs5pOzyJHT4Skp5b3-0DBBU3X8C68BEsgTbyQezGagdfLsbdMxTPByDRQyFIC1JVM9KlTtTt--Zk_zhn_jbNU9KTZSYXlKXSPLUxJPykAXr1INDiMeiVGu8oNVWZ5LpTsug Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 0b2f768290ea43cb98b058067268674d Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:36:06.486547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b2f768290ea43cb98b058067268674d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b2f768290ea43cb98b058067268674d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 0b2f768290ea43cb98b058067268674d Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: f93bd44f2fbc4be4be905c8b8ae0e343 Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {"volumeAttachment": {"volumeId": "eea4a7e8-f530-461c-96b3-72da96e66b41"}} Jul 21 22:36:06.487865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Cannot 'attach_volume' instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 while it is in vm_state rescued Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'server_id': '346cdaf4-2c29-4dd7-aae1-06e8e7954ed8', 'body': {'volumeAttachment': {'volumeId': 'eea4a7e8-f530-461c-96b3-72da96e66b41'}}} Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:36:06.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 while it is in vm_state rescued Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:06.490475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 while it is in vm_state rescued Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Returning 409 to user: Cannot 'attach_volume' instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 while it is in vm_state rescued {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f95341a4-acc3-4e30-9251-19b1e86e93d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053174 Jul 21 22:36:06.494070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 127/264] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 22:36:06 2022] POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:36:06.498660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:06.499197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.501142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:06.508221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.508754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.509497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.509930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.587809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2f843aed-a475-4db4-aaf3-15a397294e93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.093355 Jul 21 22:36:06.592249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 138/265] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:36:06 2022] POST /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:36:06.602124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.603245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.614311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.615062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.616327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.617347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.922924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:06.925683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:06.940382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.941721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.945058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:06.946093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:06.949877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:06.961411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-48609cd9-4de7-4115-91ec-255ee19640bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.367429 Jul 21 22:36:06.964639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 128/266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:06 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:07.124511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-1489be84-3821-4431-8ebe-6b558a0f05e2 req-cf120fe8-cb3f-4cb9-b98b-af8131b54f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c66088c-2251-47b8-98ef-ce8cc008be9a", "name": "network-vif-plugged", "status": "completed", "tag": "65671c0b-fd32-4d40-abe7-87f96b642d6c"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:07.142541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-1489be84-3821-4431-8ebe-6b558a0f05e2 req-cf120fe8-cb3f-4cb9-b98b-af8131b54f9e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.142987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-1489be84-3821-4431-8ebe-6b558a0f05e2 req-cf120fe8-cb3f-4cb9-b98b-af8131b54f9e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.178897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-1489be84-3821-4431-8ebe-6b558a0f05e2 req-cf120fe8-cb3f-4cb9-b98b-af8131b54f9e service nova] Creating event network-vif-plugged:65671c0b-fd32-4d40-abe7-87f96b642d6c for instance 1c66088c-2251-47b8-98ef-ce8cc008be9a on hv-cinder-85069 Jul 21 22:36:07.189313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-1489be84-3821-4431-8ebe-6b558a0f05e2 req-cf120fe8-cb3f-4cb9-b98b-af8131b54f9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069920 Jul 21 22:36:07.193440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 129/267] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:07.407038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:07.414624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:07.450914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.452654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.455069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.457121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.642544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.658391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.661376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.663147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c7abfa95-05e3-4646-bfa6-63419cf3d537 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.752433 Jul 21 22:36:07.664351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 139/268] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:07.869352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:07.883634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d5edfcde-0f97-4824-8085-bc87134ec250 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.484386 Jul 21 22:36:07.884597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 130/269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:07 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:07.981910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:07.982527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:07.988925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.989377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:07.990153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:07.991142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.148761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.163230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7eaf43e9-8437-455f-b3d6-009aeebbaeaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.184720 Jul 21 22:36:08.164203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 140/270] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:07 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:08.686325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:08.687421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:08.698646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.699205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.700540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.701254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.912032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:08.914772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:08.923702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.924452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.925706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:08.926209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:08.929447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.939672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.941502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:08.942985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aa7409f8-bce2-4d7b-ab16-0c6943b1e5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.262759 Jul 21 22:36:08.944434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 131/271] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:09.147789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.155608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-acbe6b1a-0704-4831-b9db-d1e9b17e4c39 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.249951 Jul 21 22:36:09.156192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 141/272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:08 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:09.180871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:09.181495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:09.188206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.188685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.189467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.189960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.342857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:09.352183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2b1755ad-4aef-4798-86e1-bb4d6c8ce019 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.175812 Jul 21 22:36:09.352810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 132/273] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:09 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:09.962742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:09.963548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:09.970146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.970667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:09.975700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:09.975700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.153000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:10.164980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:10.167154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:10.169867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab8ee686-f5af-4024-83ac-50c8ad73f5c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.210268 Jul 21 22:36:10.174370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:10.175222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:10.183939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.184505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 142/274] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:10.184972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.185851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.186290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.358855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:10.368338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-06e77bce-1774-4f40-94d5-88d3832c9f42 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.198115 Jul 21 22:36:10.369098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 133/275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:10 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:10.374784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:10.375427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:10.383754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.384213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.385042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:10.385483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:10.527096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:10.534868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e2bf677c-8c8d-4feb-9bf5-ce95b79e609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.164813 Jul 21 22:36:10.535458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 143/276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:10 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:11.199171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:11.199892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:11.207177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.207869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.208731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.209371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.343254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.351898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.353372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.354523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-68b949b1-29cd-4426-9044-d67b3e4a00d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.159487 Jul 21 22:36:11.355076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 134/277] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:11.385629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:11.386240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:11.392502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.392963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.393726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.394153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.539138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.546512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1f25f270-65f2-4f68-b108-c4b19fcd374d tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.164787 Jul 21 22:36:11.547064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:11 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:11.555538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:11.556144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:11.562096 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.562545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.563303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:11.563734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:11.709040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:11.721331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-10fd9546-05d8-4838-acab-3c2bacc73245 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.170242 Jul 21 22:36:11.724919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 135/279] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:11 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:12.372668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.373270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.379564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.380004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.381217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.381640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.527261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.535803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.537581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.538894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5c36194-df92-4984-b844-e75128ee6bab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1745 microversion: 2.20 time: 0.170210 Jul 21 22:36:12.539469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 145/280] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:12.566112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.566734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.574815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.575269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.576124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.576600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.732777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.739279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:12.739891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:12.747807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.748236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.748887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-661aee2b-97d0-4c9a-ad8c-3cb2a1dc98c3 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1314 microversion: 2.1 time: 0.186967 Jul 21 22:36:12.749250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:12.750022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:12.750241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 136/281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:12.762369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:12.924455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:12.936666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-81cfdfcd-8c77-42f4-9559-a3754b15609a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1509 microversion: 2.1 time: 0.201082 Jul 21 22:36:12.937428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 146/282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:12 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:13.094742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-7eced842-a95e-479e-aa50-f605722dbe50 req-8af3500a-c675-4f36-97f5-f779e771c989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "name": "network-vif-plugged", "status": "completed", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:13.104927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7eced842-a95e-479e-aa50-f605722dbe50 req-8af3500a-c675-4f36-97f5-f779e771c989 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.105378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7eced842-a95e-479e-aa50-f605722dbe50 req-8af3500a-c675-4f36-97f5-f779e771c989 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.122313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-7eced842-a95e-479e-aa50-f605722dbe50 req-8af3500a-c675-4f36-97f5-f779e771c989 service nova] Creating event network-vif-plugged:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:36:13.127391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-7eced842-a95e-479e-aa50-f605722dbe50 req-8af3500a-c675-4f36-97f5-f779e771c989 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036404 Jul 21 22:36:13.128209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 137/283] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:13.570554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.571561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.582132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.582860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.585270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.585919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.772899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.773699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.774796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.780213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.780779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.781631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.782170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.783142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.784696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.785862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-90307443-c75e-4bdf-9d2c-51172e4b33cf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.222211 Jul 21 22:36:13.786434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 147/284] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:13.949514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:13.960437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:13.961069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:13.978960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-34d3c1e0-c93f-4139-8eee-d31691a59c3e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1499 microversion: 2.1 time: 0.211371 Jul 21 22:36:13.979274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.979725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:13.980142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 138/285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:13.980536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:13.980950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.164446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:14.173019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4be048d9-6cb8-48b7-82c5-2d7c0a96211f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1515 microversion: 2.1 time: 0.217415 Jul 21 22:36:14.173677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 148/286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:13 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:14.810766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:14.811502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:14.818646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.819289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:14.820181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:14.821248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.001774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:15.011462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:15.013006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:15.014189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-75d90a3e-8236-44bf-9be7-0edd982cb3b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.211800 Jul 21 22:36:15.026070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 139/287] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:15.762236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5eb63a2e-75ad-4b91-9860-375f6db923b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: .version_select at 0x7ff1d946e550>, body: {"keypair": {"name": "tempest-keypair-306354665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKb8zm5aKCeSkp8gUxvJZl7YNmwZb0iz6co52XEzkFPkuLMooOMSYmiPDTIl36Vz0UGxRC+xrE49Ox/8Gl69iVCUVxD9rJyuXbdsx96mhzHc3U76oNbHrV5af0QaiT7Lw=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:15.795982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-5eb63a2e-75ad-4b91-9860-375f6db923b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for project 0b2f768290ea43cb98b058067268674d. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:15.801706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-5eb63a2e-75ad-4b91-9860-375f6db923b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for user f93bd44f2fbc4be4be905c8b8ae0e343 and project 0b2f768290ea43cb98b058067268674d. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:15.859376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:15.859998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:15.871163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.871901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.873006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:15.873737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:15.874929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5eb63a2e-75ad-4b91-9860-375f6db923b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124550 Jul 21 22:36:15.875988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 149/288] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 22:36:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:15.945691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:36:16.035232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:16.036100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:16.045368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.047569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.049948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.050598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.158739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b45cffef-9f01-42dc-8c88-697d113df92e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 204 len: 0 microversion: 2.1 time: 0.303732 Jul 21 22:36:16.164214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 140/289] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:36:15 2022] DELETE /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:36:16.174732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:16.175733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:16.183404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.184725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.185833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.186494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.223876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:16.469193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.481019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb64b39b-c6f7-4c5b-967e-3d0a35f46a55 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1505 microversion: 2.1 time: 0.315120 Jul 21 22:36:16.482549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 141/290] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:16 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:16.516055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.543994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.548454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.550164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b7e4a7e0-8169-4836-b7c0-6e55f1a10784 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.519155 Jul 21 22:36:16.555202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 150/291] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:17.507576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:17.517754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:17.564325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.569893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.573361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.574956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.577705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:17.580335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:17.617410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.620007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.621655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:17.622683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:17.974180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.985054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.988633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:17.989967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf3f4a09-d3c8-472d-87c6-f6db80743c96 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.419121 Jul 21 22:36:17.991094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 151/292] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:18.070456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.088741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b3ded241-982c-49f0-867d-c9801146172e tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1505 microversion: 2.1 time: 0.588610 Jul 21 22:36:18.107865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 142/293] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:17 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:18.917824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1562110677", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f92ffc2d-48a8-4898-8aa3-c6c03158f163"}], "security_groups": [{"name": "tempest-securitygroup--2052992177"}], "key_name": "tempest-keypair-306354665", "user_data": "}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:19.012546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.015837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.024813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.025343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.026396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.026893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.182557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] validate_networks() for [('f92ffc2d-48a8-4898-8aa3-c6c03158f163', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:36:19.361036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.377083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.381704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.384158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-365e8420-5227-4198-80bc-a46f00dd51ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.378201 Jul 21 22:36:19.385387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 143/294] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:19.393142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.394740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.411443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.413546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.415553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.416834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.732126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.762504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-99c3a652-dd53-4582-9e35-09f948ef2f09 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1505 microversion: 2.1 time: 0.365380 Jul 21 22:36:19.764066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 144/295] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:20.033972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:36:20.034561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:36:20.034861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:36:20.035432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:36:20.035969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:36:20.061677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.064466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.067043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.068071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.118018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:20.124229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Getting quotas for user f93bd44f2fbc4be4be905c8b8ae0e343 and project 0b2f768290ea43cb98b058067268674d. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:20.143925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:36:20.149054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:36:20.253832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6049fa34-f94c-425a-9eeb-f8c0faf71a51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.337902 Jul 21 22:36:20.265433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 152/296] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:36:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:36:20.267658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f699238a-70df-4fb0-a60e-ca6cad5897ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:20.268452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f699238a-70df-4fb0-a60e-ca6cad5897ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:20.410060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:20.483087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:20.507665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f699238a-70df-4fb0-a60e-ca6cad5897ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.520450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f699238a-70df-4fb0-a60e-ca6cad5897ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1245 microversion: 2.1 time: 0.255592 Jul 21 22:36:20.525167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 145/297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1245 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:20.565711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.566441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.567393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.568192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.782504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:20.783567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:20.794094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.796234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.801784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.803062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.924647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.935669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.951234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.964808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-951941d1-51e2-4ace-b634-e0b0d229a8d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.562257 Jul 21 22:36:20.968126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 153/298] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:21.140719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.155064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a44cb986-16f8-40c7-956d-7fd287331464 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1505 microversion: 2.1 time: 0.376992 Jul 21 22:36:21.166647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 146/299] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:20 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:21.479867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-ef1a916c-5563-432b-b954-ac05dfe2e069 req-13666112-d53c-48f4-abc4-0d186921603c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c66088c-2251-47b8-98ef-ce8cc008be9a", "name": "network-vif-deleted", "tag": "65671c0b-fd32-4d40-abe7-87f96b642d6c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:21.493441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-ef1a916c-5563-432b-b954-ac05dfe2e069 req-13666112-d53c-48f4-abc4-0d186921603c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.494608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-ef1a916c-5563-432b-b954-ac05dfe2e069 req-13666112-d53c-48f4-abc4-0d186921603c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.513167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-ef1a916c-5563-432b-b954-ac05dfe2e069 req-13666112-d53c-48f4-abc4-0d186921603c service nova] Creating event network-vif-deleted:65671c0b-fd32-4d40-abe7-87f96b642d6c for instance 1c66088c-2251-47b8-98ef-ce8cc008be9a on hv-cinder-85069 Jul 21 22:36:21.520269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-ef1a916c-5563-432b-b954-ac05dfe2e069 req-13666112-d53c-48f4-abc4-0d186921603c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045855 Jul 21 22:36:21.529230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 154/300] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:21.564760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.565918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:21.568294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:21.590461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.593225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.594433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.597400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.843033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:21.864335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c1bbe6ea-ef52-4434-9055-2978b2e85f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1241 microversion: 2.1 time: 0.305231 Jul 21 22:36:21.878969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 147/301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1241 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:21.986978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.988022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.008844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.009720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.016800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.017720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.178285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.179977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.187455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.188181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.189176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.189778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.272046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.273749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.275042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lazy-loading 'fault' on Instance uuid 1c66088c-2251-47b8-98ef-ce8cc008be9a {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:36:22.281131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.299227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.303595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.306213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-19cd842b-ca10-4a37-a410-a4bba58f1c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.323554 Jul 21 22:36:22.308398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 155/302] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:22.357172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35f252f0338547aea73d1eb7c81ca199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58636dfe0f8c463bab0031b5d6734bd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.366743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4afb232d-af5c-40cc-8438-0c6763fc0807 tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 200 len: 1304 microversion: 2.1 time: 0.195929 Jul 21 22:36:22.368092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 148/303] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 1304 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:22.916323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:22.918110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:22.942513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.946206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.949917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:22.961402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.151109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.163560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-93e524a7-900b-4e66-a5a2-8e80262f5816 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1315 microversion: 2.1 time: 0.257139 Jul 21 22:36:23.165881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 156/304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:23.327673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:23.328930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.341915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.345637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.347642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.348968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.400193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:23.400899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] [instance: 1c66088c-2251-47b8-98ef-ce8cc008be9a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.416092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.416902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.418718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.419365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.452963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] HTTP exception thrown: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Request method failure captured: Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a HTTP/1.1 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dSwCsavq4X3Qo9nBoa-h5oz0_ruTEWfsGS77zIhiMHsrROkHIA70bepHJwVQhEWgW-N4RLZmeBU6wHFogG24nPwB6Gj3lJZtINquXXj0OlmKqw7GFrlU8-uJT2SFC8crtUCBx1rNr2AsGZN9FXBVk_LG87kjALkOx7o5CwsZF2vb00 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 58636dfe0f8c463bab0031b5d6734bd9 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesActionsTest-1231401178 Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:36:23.457443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/58636dfe0f8c463bab0031b5d6734bd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesActionsTest-1231401178 Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 58636dfe0f8c463bab0031b5d6734bd9 Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesActionsTest-1231401178 Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesActionsTest-1231401178-project Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 35f252f0338547aea73d1eb7c81ca199 Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesActionsTest-1231401178-project Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. Jul 21 22:36:23.459540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '1c66088c-2251-47b8-98ef-ce8cc008be9a'} Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:36:23.460278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. Jul 21 22:36:23.462086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:36:23.464991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] Returning 404 to user: Instance 1c66088c-2251-47b8-98ef-ce8cc008be9a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:36:23.469109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-02bf8798-5171-459d-b18d-4fad610d2e5b tempest-VolumesActionsTest-1231401178 tempest-VolumesActionsTest-1231401178-project] 10.222.0.42 "GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a" status: 404 len: 111 microversion: 2.1 time: 0.071219 Jul 21 22:36:23.481099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 157/305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:23 2022] GET /compute/v2.1/servers/1c66088c-2251-47b8-98ef-ce8cc008be9a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:36:23.682208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.695506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.720000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.725296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6cb27eed-f706-4c05-82ea-afacaca167f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.398172 Jul 21 22:36:23.727722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 149/306] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:24.182249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2099896359", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "networks": [{"uuid": "45c3f81c-eebd-446b-9583-19a3c886cd25"}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:24.192463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.193981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.208308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.212192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.217447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.221032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.359000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] validate_networks() for [('45c3f81c-eebd-446b-9583-19a3c886cd25', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:36:24.470602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.507080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-463a11e9-bde0-4ae8-b727-6e6e7fa38581 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1303 microversion: 2.1 time: 0.315987 Jul 21 22:36:24.510498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 150/307] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:24.773365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.793745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.844740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.848638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.858473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.860953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.439881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:36:25.440704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:36:25.441582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:36:25.442300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:36:25.444031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:36:25.472303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.473213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.475537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.476435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.514511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Getting quotas for project b8abe8948c934248a448532711d4499b. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:25.523363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Getting quotas for user b6a2a022db8b4ef98a8c4932f753240a and project b8abe8948c934248a448532711d4499b. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:25.549372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:36:25.555001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:36:25.601440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:25.688247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f1cadd5b-1582-4f9f-ba23-7131d790a46c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.528849 Jul 21 22:36:25.689659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 158/308] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:36:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:36:25.702562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:25.703482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:25.713622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.714375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.715353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.715958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.751758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.808249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.815035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.823657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-031c29ba-63a4-4eaa-b599-4732ed9e9a22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 1.061510 Jul 21 22:36:25.825151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 151/309] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:25.839768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0adc22e5-15a5-4329-931d-b842ac963909 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:25.848578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0adc22e5-15a5-4329-931d-b842ac963909 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:26.302891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0adc22e5-15a5-4329-931d-b842ac963909 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.369787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0adc22e5-15a5-4329-931d-b842ac963909 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1219 microversion: 2.1 time: 0.535581 Jul 21 22:36:26.375107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 152/310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:25 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1219 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:26.554524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.569799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5cd3eeae-9743-4166-8681-155a6d514643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.876731 Jul 21 22:36:26.585617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 159/311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:26.850920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:26.853621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:26.866619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.867925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.869745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.870771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.283578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-fd0a85e3-785b-47ad-84a3-545de3992c51 req-3c68f966-e4d2-4377-82bf-01285b880b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:27.298592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-fd0a85e3-785b-47ad-84a3-545de3992c51 req-3c68f966-e4d2-4377-82bf-01285b880b5c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.310139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-fd0a85e3-785b-47ad-84a3-545de3992c51 req-3c68f966-e4d2-4377-82bf-01285b880b5c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.351227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-fd0a85e3-785b-47ad-84a3-545de3992c51 req-3c68f966-e4d2-4377-82bf-01285b880b5c service nova] Creating event network-changed:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 22:36:27.364146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-fd0a85e3-785b-47ad-84a3-545de3992c51 req-3c68f966-e4d2-4377-82bf-01285b880b5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084548 Jul 21 22:36:27.366461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 160/312] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:27.401736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:27.402503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:27.430919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.445644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.447195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.447761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.494948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.510745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.513087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.516057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d0d817f-464e-4600-92af-5318f5d3b82a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.673397 Jul 21 22:36:27.520366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 153/313] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:27.567122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.582122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0a0091cd-fe43-4a37-9c6d-c72876c862b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1223 microversion: 2.1 time: 0.193188 Jul 21 22:36:27.583010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 161/314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:27 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1223 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:27.608785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:27.609892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:27.622738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.623205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.623994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.628988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.869924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.887737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8af7bee-c089-4612-a4bc-b934d058c31e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.283600 Jul 21 22:36:27.888950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 154/315] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:28.541850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.542462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.557138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.557681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.559040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.560025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.605526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.608255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.646122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.646847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.647992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.648642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.809751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.827516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a1dab60f-4adc-413e-be2a-47cc5b807cf1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1215 microversion: 2.1 time: 0.229910 Jul 21 22:36:28.828158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 155/316] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:28.906596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.908362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.931681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.932454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.947937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.948467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.127209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.164046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.166115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.169221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afd69d48-3685-4692-853a-49f3f288da55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.634204 Jul 21 22:36:29.184809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 162/317] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:29.230903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.243496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d51bc41-a51f-4fc4-9786-8b188a0cd642 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.341832 Jul 21 22:36:29.244653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 156/318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:29.847999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:29.849215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:29.875434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.879665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.883141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.883597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.014192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.022181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-18bbf1fe-95d2-4b00-93a7-aba6cd9dcdad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1277 microversion: 2.1 time: 0.179066 Jul 21 22:36:30.031963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 163/319] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:29 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:30.193652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:30.195011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:30.213606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.214467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.216980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.217860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.261992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:30.263650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:30.276660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.277852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.278749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.279288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.582534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.593961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.608373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.610552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.612124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a389a2dc-4b09-49dd-9a4d-3fe0db42e375 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.423503 Jul 21 22:36:30.621470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e6918be3-0d89-4f0c-acc4-b66cf7f96c10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.356319 Jul 21 22:36:30.624369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 157/320] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:30.637229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 164/321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:31.039588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:31.040205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:31.051478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.052554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.053385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.061745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.201219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.210693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e067ff31-cf12-4ba6-9ed5-8acdd9a9d29b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1277 microversion: 2.1 time: 0.175363 Jul 21 22:36:31.211331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:31 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:31.630893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:31.631503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:31.640936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.641380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.642149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.642581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.646939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:31.648691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:31.656507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.657498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.658586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.659240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.902489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.914421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.916271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.917533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6b05f584-9d5f-4222-a746-e44eec63edcc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1740 microversion: 2.20 time: 0.291198 Jul 21 22:36:31.918082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 165/323] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:31.998267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:32.014322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:32.028700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e899f422-cabc-49b1-b6e3-f2edce432a9e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.385687 Jul 21 22:36:32.030986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 159/324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:32.230007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:32.230648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:32.238708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.239304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.240674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.242079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.512183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:32.557723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-361fd42a-f7e4-42ab-8cdf-374ffd57a7c7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.327436 Jul 21 22:36:32.572873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 166/325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:32 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:32.937962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:32.939415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:32.949336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.950134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.951626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.952279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.050973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:33.051792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:33.070279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.071209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.074627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.075391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.085587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:33.355090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.356146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.365307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.376470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b01ebb5a-435e-40bb-bda6-d2f5e7c895e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.332364 Jul 21 22:36:33.377262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.378278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 167/326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:33.379941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2948b273-8e0e-4c96-b902-a039239a860b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.447571 Jul 21 22:36:33.393288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-4707152b-7192-4951-b27d-7e7f30f77aac req-5e7fbe1e-6c28-4e9f-9167-8fe554351ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79408960-81e9-401a-9912-e594afda1417", "tag": "074476ed-e526-4cce-9bec-a51dee0433b0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:33.394927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 160/327] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:33.406173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-4707152b-7192-4951-b27d-7e7f30f77aac req-5e7fbe1e-6c28-4e9f-9167-8fe554351ebb service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.407770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-4707152b-7192-4951-b27d-7e7f30f77aac req-5e7fbe1e-6c28-4e9f-9167-8fe554351ebb service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.446502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-4707152b-7192-4951-b27d-7e7f30f77aac req-5e7fbe1e-6c28-4e9f-9167-8fe554351ebb service nova] Creating event network-changed:074476ed-e526-4cce-9bec-a51dee0433b0 for instance 79408960-81e9-401a-9912-e594afda1417 on hv-cinder-85069 Jul 21 22:36:33.456154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-4707152b-7192-4951-b27d-7e7f30f77aac req-5e7fbe1e-6c28-4e9f-9167-8fe554351ebb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075847 Jul 21 22:36:33.456786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 168/328] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:33.590654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:33.591663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:33.599821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.603192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.604385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.604856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.015592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.025535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ed0c4e34-dd3e-42af-b69b-960c79e753f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.438790 Jul 21 22:36:34.045436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 161/329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:33 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:34.402673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:34.404287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:34.404416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:34.409027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:34.413127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.413978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.415203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.415943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.427457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.430677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.431770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.432458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.604851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.613675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08d4e8cd-30a7-4834-9039-55b76e1def91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.214639 Jul 21 22:36:34.614892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 169/330] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:34.689221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.700701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.702904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.704419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4f777e0a-6f70-4624-bb99-7bfc6195c122 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.306726 Jul 21 22:36:34.705241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 162/331] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:35.056183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:35.057260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:35.064249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.065286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.066354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.066923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.216125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.224152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fde4c13b-cfb7-4001-aec7-18157ae47fc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.174088 Jul 21 22:36:35.224735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 170/332] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:35 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:35.633223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:35.633731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:35.641959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.642417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.647488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.647488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.725703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:35.727153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:35.732276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:35.734741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=16 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:35.747251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.748436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.749931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.750588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.789086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.800193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-77d5b789-5b37-4d23-a293-cc33bdad1221 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.171544 Jul 21 22:36:35.812535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 163/333] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:35.911805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.923598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.925619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.927126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f798abb4-3227-4d85-a092-c652d73eb438 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.207687 Jul 21 22:36:35.927748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 171/334] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:36.243111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.243784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.252427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.253365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.254944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.256321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.335638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:36.425429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:36.434263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-11df78b3-1fbf-4a7c-b4af-6f244c2bcf15 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.196586 Jul 21 22:36:36.438030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 164/335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:36.663848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-0512fd1a-aa4e-44cc-83a2-dceaf53a1220 req-446c888c-4d11-4418-a0cb-f6c9a762c78a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "name": "network-vif-plugged", "status": "completed", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:36.674228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-0512fd1a-aa4e-44cc-83a2-dceaf53a1220 req-446c888c-4d11-4418-a0cb-f6c9a762c78a service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.674761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-0512fd1a-aa4e-44cc-83a2-dceaf53a1220 req-446c888c-4d11-4418-a0cb-f6c9a762c78a service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.688774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-0512fd1a-aa4e-44cc-83a2-dceaf53a1220 req-446c888c-4d11-4418-a0cb-f6c9a762c78a service nova] Creating event network-vif-plugged:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 22:36:36.695614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-0512fd1a-aa4e-44cc-83a2-dceaf53a1220 req-446c888c-4d11-4418-a0cb-f6c9a762c78a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Jul 21 22:36:36.696215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 172/336] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:36.820718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.821348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.832321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.838818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.839721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.840169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.954656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.956733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.975815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.976894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.978902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.980198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:37.001537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.010536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-400cc400-a7ad-47cb-b59d-d6f455c75a4c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.195058 Jul 21 22:36:37.011096 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 165/337] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:37.163859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.174084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.177663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.179479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2cc6244d-497b-411a-bbdd-f540f4983ece tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.236316 Jul 21 22:36:37.180833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 173/338] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:37.456350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:37.457021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:37.463461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:37.463858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:37.464829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:37.465261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:37.606396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.615073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1dd82e6e-4df1-42a7-a614-664cd10fce62 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.161936 Jul 21 22:36:37.615647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 166/339] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:37 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:38.029194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:38.030029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:38.039284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.039913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.040943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.041750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.199000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:38.199538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:38.200649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:38.207148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-17222434-7a68-45ae-a887-02e1a8f72edd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.183485 Jul 21 22:36:38.207942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:38.209379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.209843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.210649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.211237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.354592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:38.362887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:38.365078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:38.366245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89bc728a-a253-4b74-9f59-9237a1e8cc7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.172025 Jul 21 22:36:38.366795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 167/341] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:38.633960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:38.634862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:38.641096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.641548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.642350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.642860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.719453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-f4757d3e-469c-475a-8aa8-63a19655ed0b req-52dbbc4f-e40d-41cf-a844-7d4070a33186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "name": "network-vif-unplugged", "status": "completed", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:38.729342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-f4757d3e-469c-475a-8aa8-63a19655ed0b req-52dbbc4f-e40d-41cf-a844-7d4070a33186 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.730013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-f4757d3e-469c-475a-8aa8-63a19655ed0b req-52dbbc4f-e40d-41cf-a844-7d4070a33186 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.744210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-f4757d3e-469c-475a-8aa8-63a19655ed0b req-52dbbc4f-e40d-41cf-a844-7d4070a33186 service nova] Creating event network-vif-unplugged:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:36:38.750317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-f4757d3e-469c-475a-8aa8-63a19655ed0b req-52dbbc4f-e40d-41cf-a844-7d4070a33186 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034409 Jul 21 22:36:38.751254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 168/342] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:38.800233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:38.810495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3a18f313-b10a-433b-9d20-8d7fa7654ed7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.181540 Jul 21 22:36:38.816585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 175/343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:38 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:39.228753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:39.229569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:39.236733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.237243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.237954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.238382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.388172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:39.389173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:39.403512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.410132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.411408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.412735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.419856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9402e245-81db-42bb-9009-3f82ffe0e348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.199251 Jul 21 22:36:39.423551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 169/344] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:39.424233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.599277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.611362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.613526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.614656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d174a53a-fb68-46b8-b441-a7eba5988759 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1722 microversion: 2.20 time: 0.231668 Jul 21 22:36:39.615671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 176/345] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:39.858721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:39.859268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:39.866918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.867366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.868168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.868651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.209692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:40.227307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0f927827-557a-4ee5-8df5-a41e3bca45e6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.373789 Jul 21 22:36:40.236927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 170/346] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:39 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:40.440436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:40.441082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:40.452882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.453406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.460516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.460976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.635375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:40.636349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:40.653372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.654079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.655101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.655817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.702159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:40.710996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-87225015-1c14-4210-b7a8-ba4c0605a439 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.274675 Jul 21 22:36:40.711570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 177/347] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:41.245093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:41.245711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:41.251996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.252461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.257691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.258161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.305206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.329664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.331757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.334783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-788a7bd6-ccab-4823-8a1f-b72e0f5394d1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1725 microversion: 2.20 time: 0.704454 Jul 21 22:36:41.349212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 171/348] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1725 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:41.361697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60e5a573-ae11-4d95-86c1-946caff08f04"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:41.363361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:41.373799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.374478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.375437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.376025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.538363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.549230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b910fe63-6b16-4a10-8cc7-d4f6bd8f29dd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.308102 Jul 21 22:36:41.550355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 178/349] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:41 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:41.729096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:41.730281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:41.740464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.741241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.742329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.743057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.840827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-df7d4644-9a1a-49d9-a703-07096c2e24e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.483232 Jul 21 22:36:41.842686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 172/350] 10.222.0.42 () {62 vars in 1363 bytes} [Thu Jul 21 22:36:41 2022] POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 188 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:36:41.945537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.975020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9ded236c-cb93-4d22-be4d-182f7c542136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1371 microversion: 2.1 time: 0.251346 Jul 21 22:36:41.975542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 179/351] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:42.015792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:42.021939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:42.028531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.029149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.030675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.031378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.158648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:42.195247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3a464ce3-80f3-4bd0-a58d-5af8e79ede0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action" status: 202 len: 0 microversion: 2.20 time: 0.184533 Jul 21 22:36:42.196226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 173/352] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 22:36:42 2022] POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:36:42.206010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:42.206622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:42.217079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.217553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.218333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.218770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.452777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:42.468813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:42.471101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:42.474345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1945ece2-ae44-4406-9621-527518179b92 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.272037 Jul 21 22:36:42.474345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 180/353] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:42.569122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:42.570526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:42.577759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.578339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.579249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.579885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.797629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:42.811394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5c3acbd4-845a-4014-849a-d1c307dc5ecc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.247120 Jul 21 22:36:42.812958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 174/354] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:42 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:42.993674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-6a97361a-d26a-4db2-88ad-e16e4d25c4fb req-b14a2e44-6794-4c62-b16a-615d9fec6df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79408960-81e9-401a-9912-e594afda1417", "name": "network-vif-plugged", "status": "completed", "tag": "074476ed-e526-4cce-9bec-a51dee0433b0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:42.995305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:42.996291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:43.010169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.016626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.024046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.025557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.041309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6a97361a-d26a-4db2-88ad-e16e4d25c4fb req-b14a2e44-6794-4c62-b16a-615d9fec6df5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.041873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6a97361a-d26a-4db2-88ad-e16e4d25c4fb req-b14a2e44-6794-4c62-b16a-615d9fec6df5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.061353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-6a97361a-d26a-4db2-88ad-e16e4d25c4fb req-b14a2e44-6794-4c62-b16a-615d9fec6df5 service nova] Creating event network-vif-plugged:074476ed-e526-4cce-9bec-a51dee0433b0 for instance 79408960-81e9-401a-9912-e594afda1417 on hv-cinder-85069 Jul 21 22:36:43.072891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-6a97361a-d26a-4db2-88ad-e16e4d25c4fb req-b14a2e44-6794-4c62-b16a-615d9fec6df5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086678 Jul 21 22:36:43.076156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 181/355] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:43.378376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:43.394144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ba14986e-206d-4026-9a5a-0bda30b5f835 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1565 microversion: 2.1 time: 0.406463 Jul 21 22:36:43.395353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 175/356] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1565 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:43.438127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:43.439353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:43.463482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.465029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.466713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.467379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.509150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:43.510015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:43.531358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.531728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.532667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.532987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.574566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc6db8db-0f8e-493e-88f4-273d18ce98be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165730 Jul 21 22:36:43.580575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 182/357] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 22:36:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:43.717562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:43.731596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:43.734612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:43.736465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-975339a7-78b3-413e-a0a9-76a48a6ded2d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.247964 Jul 21 22:36:43.737977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 176/358] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:43.833292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:43.834089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:43.841281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.842008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:43.843190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:43.843763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:44.352212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:44.361423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6322884d-c52d-425a-a2e5-0f56ec0aced5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.533844 Jul 21 22:36:44.361994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:43 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:44.757880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:44.758695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:44.767603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:44.768401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:44.769421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:44.770108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.131324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:45.143566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:45.148068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:45.149389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0f7108f5-20cc-471b-bbf8-34b84dbec3dd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.397595 Jul 21 22:36:45.152936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 177/360] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:45.223698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-3a87c3dc-01b3-48e8-883a-9f34d0bd8e59 req-fecd67de-375e-4361-a4b9-cc6fc62dd267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:45.242062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3a87c3dc-01b3-48e8-883a-9f34d0bd8e59 req-fecd67de-375e-4361-a4b9-cc6fc62dd267 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.242812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3a87c3dc-01b3-48e8-883a-9f34d0bd8e59 req-fecd67de-375e-4361-a4b9-cc6fc62dd267 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.267406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-3a87c3dc-01b3-48e8-883a-9f34d0bd8e59 req-fecd67de-375e-4361-a4b9-cc6fc62dd267 service nova] Creating event network-changed:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 22:36:45.281180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-3a87c3dc-01b3-48e8-883a-9f34d0bd8e59 req-fecd67de-375e-4361-a4b9-cc6fc62dd267 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063245 Jul 21 22:36:45.282275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 184/361] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:45.380251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:45.381266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:45.387929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.388651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.389597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:45.390296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:45.677477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:45.687795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a1b080c0-ce58-4456-8f19-893cfe3b8f0e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1319 microversion: 2.1 time: 0.312336 Jul 21 22:36:45.689103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 178/362] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:45 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:46.170655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:46.172330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:46.181028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.181784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:46.183069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.183431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:46.450172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:46.460662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:46.462446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:46.463837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cd6cabfe-a58c-447c-9b6b-18e41935180f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.299080 Jul 21 22:36:46.464948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 185/363] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:46.711798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:46.713254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:46.735753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.737504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:46.739527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:46.740624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:46.931131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:46.940278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d5f6112b-e102-4f4f-9825-34d62e6a4fd3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1508 microversion: 2.1 time: 0.234724 Jul 21 22:36:46.942955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 179/364] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:46 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:47.482979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:47.483623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:47.490773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:47.491464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:47.492325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:47.492748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:47.648202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:47.652234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:47.661658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:47.663648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:47.665091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-15f212d5-dfd3-4528-93e5-8970170ee554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.186221 Jul 21 22:36:47.665854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 186/365] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:48.693567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:48.694743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:48.701709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:48.702570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:48.703511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:48.704100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:48.959646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:48.968435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:48.970920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:48.972515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be6eb202-1c66-49db-bfa9-1adf26fe12f2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1751 microversion: 2.20 time: 0.283521 Jul 21 22:36:48.974604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 180/366] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1751 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:49.998619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:50.005575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:50.014783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:50.022657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:50.023492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:50.023934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:50.163855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:50.174219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:50.177276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:50.178474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9f1451b-681e-4132-823c-bef043257c94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1753 microversion: 2.20 time: 0.187462 Jul 21 22:36:50.179029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 187/367] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:51.198232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:51.199426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:51.206151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:51.206890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:51.208501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:51.209091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:51.404497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:51.414639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:51.416225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:51.417679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-47a0615b-546c-4efc-8db4-891756d7d803 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.223514 Jul 21 22:36:51.418214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 181/368] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:36:52.448656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:52.449958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:52.464564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:52.466331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:52.469587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:52.471257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:52.826808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:52.836708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:52.838427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:52.841613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eb000e67-cbed-4ec6-af82-c4f04cc1f079 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.404782 Jul 21 22:36:52.842254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 188/369] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:53.862276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:53.863621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:53.866151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=76 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:53.874056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.874914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:53.875972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:53.876604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:54.064400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:54.073672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:54.075253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:54.076720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c531d338-5dc7-490e-8151-57fbc9e49085 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.219066 Jul 21 22:36:54.077154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 182/370] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:55.098901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:55.099610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:55.106895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.107395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.108286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:55.108929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:55.273727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:55.287209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:55.289195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:55.290603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be633bf5-56fe-464a-aab3-21a6253811fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.198334 Jul 21 22:36:55.291160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 189/371] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:56.310534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:56.311166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:56.318387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.318968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.319908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:56.320535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:56.479026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:56.489559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:56.490948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:56.491634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cff6fc88-71a3-4641-8f8f-0f858f460cb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.185073 Jul 21 22:36:56.492205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 183/372] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:57.515005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:57.516471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:57.523380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=63 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:57.525461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.526106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.527152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:57.527837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:57.745949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:57.760986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:57.762640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:57.763882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-83bd33cf-8e79-41eb-a050-17c6803cb486 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.256644 Jul 21 22:36:57.764460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 190/373] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:58.783150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:58.783861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:58.792038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.792619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:58.793398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:58.793826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:58.951091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:58.961050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:58.962504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:58.963856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-defc6406-f847-4770-a8cb-e4e8bf54dd58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.184609 Jul 21 22:36:58.964576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 184/374] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:36:59.983026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:59.983622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:59.990626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:59.991071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:59.991835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:59.992265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:00.144218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:00.153986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:00.155743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:00.157047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2eef8182-0b30-43c3-b4d5-30401fa7e1bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.177691 Jul 21 22:37:00.157621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 191/375] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:36:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:01.177017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:01.177794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:01.184308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:01.184763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:01.185546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:01.186072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:01.335988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:01.344799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:01.346345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:01.348197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ccaab6a6-d90b-4048-8358-e3a0a0dbeb7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.176586 Jul 21 22:37:01.349085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 185/376] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:02.366519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:02.367318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:02.375007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.375557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.376409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:02.380383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:02.537787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:02.555811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:02.558572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:02.559865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e8cc749d-4d1d-433b-99c9-877582aba513 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.197801 Jul 21 22:37:02.560554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 192/377] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:03.580458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:03.581320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:03.589163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.589612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.591132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:03.591585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:03.743391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:03.752474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:03.754052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:03.756252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6fdb5e2f-a4c5-4a1e-a552-3b216844c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.180520 Jul 21 22:37:03.757267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 186/378] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:04.776149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:04.776846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:04.782979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:04.783426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:04.784199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:04.784660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:04.944010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:04.953989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:04.955517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:04.956806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e85cd91d-f401-4c3a-90f1-c0aededb9608 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.184724 Jul 21 22:37:04.958640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 193/379] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:05.982668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:05.983907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:05.991429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:05.991895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:05.992713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:05.993158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:06.135511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:06.145609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:06.147319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:06.148578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7824d84f-5d6b-42b4-b20c-955992beded7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.169948 Jul 21 22:37:06.149129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 187/380] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:07.166869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:07.169271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:07.178639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:07.179659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:07.180644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:07.182167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:07.379962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:07.388635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:07.390310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:07.391480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8132de68-b6f4-4a1f-96f7-9098aea9f3f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.228747 Jul 21 22:37:07.392037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 194/381] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:08.410164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:08.410910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:08.417665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:08.418217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:08.419196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:08.419824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:08.571994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:08.581120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:08.582966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:08.584148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c4693f7d-7b9c-40c8-b1ad-f5d00a84ac71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.178178 Jul 21 22:37:08.584743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 188/382] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:09.602274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:09.603994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:09.611173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:09.611706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:09.612739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:09.613169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:09.763145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:09.774073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:09.775589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:09.776816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d054b19a-0a37-4a94-98df-7fc534f8f2b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.179068 Jul 21 22:37:09.777593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 195/383] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:10.796090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:10.796708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:10.804431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:10.804942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:10.805721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:10.806155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:11.059668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:11.069472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:11.071700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:11.073760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6a6691f2-7441-4410-8b2e-84f37e11deab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.281466 Jul 21 22:37:11.074432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 189/384] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:11.531855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aba06bbb-7e22-4b3d-a3ee-c26855613343", "device": "/dev/sdb"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:11.534189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:11.548334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:11.549033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:11.549747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:11.550168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:11.973742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-99183fb1-48c0-43c2-9bcd-1014d8e620f7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "POST /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444673 Jul 21 22:37:11.974689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 196/385] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 22:37:11 2022] POST /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:12.094263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:12.094873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:12.107227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.107679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.108466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:12.112570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:12.123680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:12.385163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:12.396910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:12.400867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:12.402154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-83da152d-dab1-4f4a-afe0-df091a7ec78f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.312034 Jul 21 22:37:12.402986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 190/386] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:13.425074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:13.425996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:13.432989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:13.434103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:13.435370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:13.436103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:13.637676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:13.647237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:13.648729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:13.649940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-baa30f81-3a25-42f2-9e2c-52e733a1e753 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.231901 Jul 21 22:37:13.650496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 197/387] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:14.676448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:14.678696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:14.701055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.704070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.705550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:14.706329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:14.990408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:15.007990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:15.013226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:15.014633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-752d5ce2-1afc-4a15-a376-9e6d44be22a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.348578 Jul 21 22:37:15.032513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 191/388] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:16.046679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:16.048105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:16.075007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.075486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.076288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:16.076763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:16.429208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:37:16.430144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:37:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:37:16.532864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:16.550037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:16.554682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:16.569125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8dc2c0e7-5f4f-48d7-b76a-b65cedbf6703 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.526922 Jul 21 22:37:16.574405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 198/389] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:17.598267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:17.599856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:17.611342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.615940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:17.619561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:17.620195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.013698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:18.023318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:18.024851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:18.026038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-58db96bb-3099-46f4-b030-cd3ba0060acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.432107 Jul 21 22:37:18.026609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 192/390] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:37:18.646662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-165e0a40-fa68-49a5-8c6e-4f7fe311a519 req-cb218eb0-5ba6-48c4-a994-b259b56b7b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "name": "network-vif-plugged", "status": "completed", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:18.671432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-165e0a40-fa68-49a5-8c6e-4f7fe311a519 req-cb218eb0-5ba6-48c4-a994-b259b56b7b44 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:18.673034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-165e0a40-fa68-49a5-8c6e-4f7fe311a519 req-cb218eb0-5ba6-48c4-a994-b259b56b7b44 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:18.701137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:18.715374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-165e0a40-fa68-49a5-8c6e-4f7fe311a519 req-cb218eb0-5ba6-48c4-a994-b259b56b7b44 service nova] Creating event network-vif-plugged:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:37:18.732064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-165e0a40-fa68-49a5-8c6e-4f7fe311a519 req-cb218eb0-5ba6-48c4-a994-b259b56b7b44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091728 Jul 21 22:37:18.736771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 199/391] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:19.046571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:19.049348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:19.062200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.062694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.063466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:19.063910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:19.252906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:19.271648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:19.275616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:19.278118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6a610d26-d053-48d0-b4f5-fd6468842d63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.235479 Jul 21 22:37:19.279268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 193/392] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:20.313009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:20.314012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:20.323196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.323910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.324897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:20.325472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:20.493966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cd3e2118-7e05-44f1-9aa9-c493fb8df193 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Action: 'create', calling method: .version_select at 0x7ff1d8b6ab80>, body: {"keypair": {"name": "tempest-TestShelveInstance-2145590754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU6nSXhVAnMpMUw2UJfxNE5/L1PCX3K9+GBOix5XNSupCwQz2dDj+GPKhEswCaKamxfElkN/Hj7ltBijYSE2ZzP1BrBu14ubDV+Jezp1kgpO8vM1tD1NSqEs21lrKCSTQ=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:20.510654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-cd3e2118-7e05-44f1-9aa9-c493fb8df193 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Getting quotas for project 671dbc43a5c04a26b23e278f3f7964bb. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:20.515370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-cd3e2118-7e05-44f1-9aa9-c493fb8df193 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Getting quotas for user 68f8c3b4d761425db457093edfccce6b and project 671dbc43a5c04a26b23e278f3f7964bb. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:20.547534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cd3e2118-7e05-44f1-9aa9-c493fb8df193 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326636 Jul 21 22:37:20.554829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 200/393] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 22:37:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:20.555170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.560731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.562299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:20.563797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1ca58d0a-3f93-449e-b715-a141cd7d922a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.256386 Jul 21 22:37:20.564576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 194/394] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:21.585225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:21.587724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:21.605558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.606983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.608234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:21.609056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:21.884466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.896286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.898326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:21.900290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e937db3b-d55e-4a50-9b35-eb59ddb7b4a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.320371 Jul 21 22:37:21.902063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 201/395] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:22.924325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:22.926223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:22.934328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.934786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:22.935585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:22.936026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:23.109227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.125776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.127906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:23.130852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9cd9db7f-9d7f-40a7-b04d-7b9693b75559 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.210441 Jul 21 22:37:23.131796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 195/396] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:24.158045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:24.158660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:24.165543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.165986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.166756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:24.167181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:24.319071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.329072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.330632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:24.332183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-67eb05d3-f899-4b77-ab14-d518528c1dbe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.178041 Jul 21 22:37:24.332780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 202/397] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:25.357762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:25.358795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:25.362958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=28 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:25.369406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:25.369936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.371060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:25.371830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:25.545796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.555995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.557576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:25.559611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5014bce0-da0a-4997-847b-80f77c27aba8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.209485 Jul 21 22:37:25.560175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 196/398] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:26.579985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:26.581185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:26.594240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.595069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.596116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:26.596938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:26.858588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:26.869872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:26.871581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:26.874238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9e507d4-b4df-489e-a466-188dc6307d30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.297085 Jul 21 22:37:26.874873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 203/399] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:27.897186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:27.898173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:27.905588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:27.905978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:27.906758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:27.907203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:28.089583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:28.098838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:28.100990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:28.102188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-17940f21-de36-4a8e-9b53-de78e94001c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.210816 Jul 21 22:37:28.102997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 197/400] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:29.121052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:29.121666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:29.124186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:29.131082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:29.131532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:29.132324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:29.132805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:29.286254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:29.295193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:29.296749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:29.297934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf685d6f-9d81-4a8b-89b4-9f18451ac808 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.180865 Jul 21 22:37:29.298492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 204/401] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:30.319311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:30.320317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:30.335063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:30.335987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:30.337735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:30.338598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:30.527832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.537085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.538652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:30.539871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8f1fb061-09ae-483f-8668-51874a2701e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1809 microversion: 2.20 time: 0.225342 Jul 21 22:37:30.540427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 198/402] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:31.560295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:31.560939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:31.563411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:31.570297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.570767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.571541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:31.571979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:31.722119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.731261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.732821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:31.734016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ef25cc76-548d-454b-a4a7-a914b2b88d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1796 microversion: 2.20 time: 0.177827 Jul 21 22:37:31.734592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 205/403] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:37:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1796 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:37:38.889284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:38.889831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:38.899602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.900059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:38.900880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:38.901321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:39.050414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 79408960-81e9-401a-9912-e594afda1417 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:37:39.173782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c7946b64-9c36-49cf-9e98-0594e23a86f0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417/os-volume_attachments/aba06bbb-7e22-4b3d-a3ee-c26855613343" status: 202 len: 0 microversion: 2.1 time: 0.288373 Jul 21 22:37:39.174372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 199/404] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:37:38 2022] DELETE /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417/os-volume_attachments/aba06bbb-7e22-4b3d-a3ee-c26855613343 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:37:40.320572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:40.321468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:40.330941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.331656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.334968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.335420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.366481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:37:40.464385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4dc9df75-3225-489d-bf99-ed9ef4b740fa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 204 len: 0 microversion: 2.1 time: 0.149268 Jul 21 22:37:40.465227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 206/405] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:37:40 2022] DELETE /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:37:40.475079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:40.475899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:40.482829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.483285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.484068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:40.484534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:40.629494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:40.640694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-580c3638-554d-44b7-a423-51cfb613f70b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1514 microversion: 2.1 time: 0.170336 Jul 21 22:37:40.641565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 200/406] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:40 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:41.662331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:41.663197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:41.671452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.671896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.672732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:41.673166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:41.824042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:41.831687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d427f7ae-46d5-47e5-b6b8-2587596b1c88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1514 microversion: 2.1 time: 0.175968 Jul 21 22:37:41.832256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 207/407] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:41 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:42.858837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:42.859816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:42.866595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.867050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.867847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:42.868297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:42.871437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:43.048971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:43.058533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4b9cb0a0-9cb4-425d-966e-8744cb8ef13a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1514 microversion: 2.1 time: 0.205184 Jul 21 22:37:43.059112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 201/408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:42 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:44.050549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-d4a63579-ac33-40a3-b2d4-dae7de43cfaa req-49f43e92-1cab-4f96-b3e0-b67cc50a2a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79408960-81e9-401a-9912-e594afda1417", "name": "network-vif-deleted", "tag": "074476ed-e526-4cce-9bec-a51dee0433b0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:44.062138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-d4a63579-ac33-40a3-b2d4-dae7de43cfaa req-49f43e92-1cab-4f96-b3e0-b67cc50a2a0e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.062578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-d4a63579-ac33-40a3-b2d4-dae7de43cfaa req-49f43e92-1cab-4f96-b3e0-b67cc50a2a0e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.076099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:44.077368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:44.086101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.086652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.088181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:44.088717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:44.089777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-d4a63579-ac33-40a3-b2d4-dae7de43cfaa req-49f43e92-1cab-4f96-b3e0-b67cc50a2a0e service nova] Creating event network-vif-deleted:074476ed-e526-4cce-9bec-a51dee0433b0 for instance 79408960-81e9-401a-9912-e594afda1417 on hv-cinder-85069 Jul 21 22:37:44.118904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-d4a63579-ac33-40a3-b2d4-dae7de43cfaa req-49f43e92-1cab-4f96-b3e0-b67cc50a2a0e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071211 Jul 21 22:37:44.122080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 208/409] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:44.196778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:44.204888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c915fd1-6f7c-4b19-aa3d-4ffd8b3401da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 200 len: 1472 microversion: 2.1 time: 0.132725 Jul 21 22:37:44.205476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 202/410] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:44 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 1472 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:45.226356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:45.227170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 79408960-81e9-401a-9912-e594afda1417] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:45.235427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.235885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.237141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:45.237798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:45.253041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] HTTP exception thrown: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Request method failure captured: Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 HTTP/1.1 Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dTkRJYQTG25lb2Tw3cQh-d2wLbUCIaXr4w4d6egkWR-_8X8mjQbk310Okz6AQJOrKCJ3bJ9F42oeIcw5PWZjJx-JHYujEad4JLtjX7IrS4F4r7UHa1YIl_p0BUPpY5vHzN9cbyqxV9NYUuc-umME4E1L_coBFt7O5e7zoiVFu38RGY Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: b8abe8948c934248a448532711d4499b Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:37:45.255745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8abe8948c934248a448532711d4499b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8abe8948c934248a448532711d4499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: b8abe8948c934248a448532711d4499b Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b6a2a022db8b4ef98a8c4932f753240a Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. Jul 21 22:37:45.258047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '79408960-81e9-401a-9912-e594afda1417'} Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:37:45.258999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. Jul 21 22:37:45.261074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:37:45.262516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Returning 404 to user: Instance 79408960-81e9-401a-9912-e594afda1417 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:37:45.262516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-940902f6-3767-410b-917a-1f2e21ab8570 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417" status: 404 len: 111 microversion: 2.1 time: 0.036403 Jul 21 22:37:45.262516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 209/411] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:45 2022] GET /compute/v2.1/servers/79408960-81e9-401a-9912-e594afda1417 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:50.460991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be9a2446-ac07-4d36-b75e-d3eab2d1bafb"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:50.463156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:50.475490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.476577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.477953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:50.478959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:50.834012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9ff0be1-ed16-44b1-be22-71cbae8a4954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.381440 Jul 21 22:37:50.834658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 203/412] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 22:37:50 2022] POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:37:55.274237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-784656673", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "networks": [{"uuid": "45c3f81c-eebd-446b-9583-19a3c886cd25"}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:55.281646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:55.282310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:55.331698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] validate_networks() for [('45c3f81c-eebd-446b-9583-19a3c886cd25', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:37:55.741739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:37:55.742342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:37:55.742810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:37:55.743210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:37:55.743614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:37:55.753837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.754293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.755103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:55.755543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:55.774297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Getting quotas for project b8abe8948c934248a448532711d4499b. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:55.779024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Getting quotas for user b6a2a022db8b4ef98a8c4932f753240a and project b8abe8948c934248a448532711d4499b. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:55.791968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:37:55.794317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:37:55.841644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-07c209eb-0572-472a-ba59-415c78a2f55a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571330 Jul 21 22:37:55.842471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 210/413] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:37:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:37:55.854832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-34c6673d-08c1-4397-a700-60c24cd9b675 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:55.855553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-34c6673d-08c1-4397-a700-60c24cd9b675 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:55.857660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=16 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:37:55.928026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-34c6673d-08c1-4397-a700-60c24cd9b675 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:55.937324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-34c6673d-08c1-4397-a700-60c24cd9b675 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1218 microversion: 2.1 time: 0.087540 Jul 21 22:37:55.937913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 204/414] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:56.581531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-821696638", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2145590754", "security_groups": [{"name": "tempest-secgroup-smoke-2076850096"}], "networks": [{"uuid": "0bb98137-e05f-4f61-b252-549892593083"}], "block_device_mapping_v2": [{"uuid": "9d1d3635-ac9c-4d12-9f84-b8ff45cacd8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:56.709715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] validate_networks() for [('0bb98137-e05f-4f61-b252-549892593083', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:37:56.956340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:56.958438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:56.966230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:56.966886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:56.967781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:56.968385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:57.047841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:57.056903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9624795e-4703-4ca8-bb6b-da4f16a5b03c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1270 microversion: 2.1 time: 0.105737 Jul 21 22:37:57.057501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 205/415] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:57.157146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:37:57.157689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:37:57.158413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:37:57.158923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:37:57.159437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:37:57.169715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:57.170317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:57.171253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:57.171795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:57.191886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Getting quotas for project 671dbc43a5c04a26b23e278f3f7964bb. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:37:57.199301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Getting quotas for user 68f8c3b4d761425db457093edfccce6b and project 671dbc43a5c04a26b23e278f3f7964bb. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:37:57.297789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:37:57.299959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d1d3635-ac9c-4d12-9f84-b8ff45cacd8a',volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:37:57.454480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-43d6d931-60eb-42c7-987c-0f569444b5cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.877300 Jul 21 22:37:57.456698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 211/416] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 22:37:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:37:57.466122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-571cf23c-e8dd-401c-8525-20743d7f644a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:57.467053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-571cf23c-e8dd-401c-8525-20743d7f644a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:57.590149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-571cf23c-e8dd-401c-8525-20743d7f644a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:57.602855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-571cf23c-e8dd-401c-8525-20743d7f644a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1088 microversion: 2.1 time: 0.140474 Jul 21 22:37:57.604312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1088 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:58.087085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:58.088931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:58.106648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.107925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.110291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.111916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.342049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:58.367429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fcc0f825-1f58-4db7-8660-d284e011c1a0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.292631 Jul 21 22:37:58.369447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 212/418] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:37:58.627413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:58.629104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:58.638540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.638994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.639789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.640560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:58.726480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:58.739853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-100df5af-092f-4c75-aed5-d47817bc77f2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1186 microversion: 2.1 time: 0.117096 Jul 21 22:37:58.741237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 207/419] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1186 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:58.982084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-5bd6a5e7-4e13-4e9b-b309-87c70ebc65db req-610eddf2-901f-4055-9366-a42768a14c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02526e73-3f8e-4ab0-a000-79f1250f9be2", "tag": "7bff8f72-d3ae-4525-8a5a-82fcdee1ec61"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:37:58.994622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-5bd6a5e7-4e13-4e9b-b309-87c70ebc65db req-610eddf2-901f-4055-9366-a42768a14c54 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:58.995074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-5bd6a5e7-4e13-4e9b-b309-87c70ebc65db req-610eddf2-901f-4055-9366-a42768a14c54 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.009311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-5bd6a5e7-4e13-4e9b-b309-87c70ebc65db req-610eddf2-901f-4055-9366-a42768a14c54 service nova] Creating event network-changed:7bff8f72-d3ae-4525-8a5a-82fcdee1ec61 for instance 02526e73-3f8e-4ab0-a000-79f1250f9be2 on hv-cinder-85069 Jul 21 22:37:59.015842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-5bd6a5e7-4e13-4e9b-b309-87c70ebc65db req-610eddf2-901f-4055-9366-a42768a14c54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038866 Jul 21 22:37:59.016845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 213/420] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:37:59.386760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:59.387645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:59.396774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.397354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.398366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.398956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.759445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:59.763436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:37:59.764775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:37:59.775368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a41e56db-284f-45aa-aff2-7daa5023ea33 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.392336 Jul 21 22:37:59.776422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 208/421] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:59 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:37:59.782911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.784118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.787097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:37:59.788922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:37:59.897576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:37:59.906238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8709848d-ef2f-4ee4-b6a8-3a95a83813fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1204 microversion: 2.1 time: 0.150451 Jul 21 22:37:59.906823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 214/422] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:37:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1204 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:00.793909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:00.794523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:00.802190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.802728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.803514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.803950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.923193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:00.924416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:00.933309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.934328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.934526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:00.934959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:00.952287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:00.961958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4ce768cd-8ab0-419c-b775-7dd74c82e455 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.171876 Jul 21 22:38:00.962656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 209/423] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:01.093852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:01.102438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2d95423d-87bb-40c7-9e53-c3e3f9836778 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1272 microversion: 2.1 time: 0.183088 Jul 21 22:38:01.103023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 215/424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:01.933986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-7f5b218b-723e-4a28-9519-b5756db20c2c req-1cd78e88-9830-4f7d-8d42-33a8f7602c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:01.963961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7f5b218b-723e-4a28-9519-b5756db20c2c req-1cd78e88-9830-4f7d-8d42-33a8f7602c5f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:01.964938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-7f5b218b-723e-4a28-9519-b5756db20c2c req-1cd78e88-9830-4f7d-8d42-33a8f7602c5f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:01.977836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-7f5b218b-723e-4a28-9519-b5756db20c2c req-1cd78e88-9830-4f7d-8d42-33a8f7602c5f service nova] Creating event network-changed:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:38:01.982282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:01.983399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-7f5b218b-723e-4a28-9519-b5756db20c2c req-1cd78e88-9830-4f7d-8d42-33a8f7602c5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053924 Jul 21 22:38:01.983535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:01.984610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 210/425] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:01.996511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:01.997352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:01.998797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:01.999554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:02.120328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:02.121397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:02.131667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:02.133106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:02.134178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:02.134796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:02.202730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:02.217578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-50131e19-e28f-4996-b602-6c02d4543d94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.241410 Jul 21 22:38:02.218783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 216/426] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:02.583526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:02.592836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e404346e-d5ee-450f-87f9-b0773d67ce41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1272 microversion: 2.1 time: 0.477133 Jul 21 22:38:02.593432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 211/427] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:02.804912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:02.806018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:02.813614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:02.814153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:02.815055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:02.815571 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:02.846990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lazy-loading 'flavor' on Instance uuid 5a0581a2-5f0c-492d-8051-d7a05bc96786 {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:03.129859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52e262b5-0705-4d59-9356-10edecf48fca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action" status: 200 len: 32 microversion: 2.1 time: 0.330409 Jul 21 22:38:03.132786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 217/428] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:38:02 2022] POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:38:03.139784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:03.140402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:03.148121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.148608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.149407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.149840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.235927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:03.236707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:03.246260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.246721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.247509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.247950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.308903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:03.320015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e16b3f0-0696-4da0-932e-d73c0c769969 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.184073 Jul 21 22:38:03.320903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 212/429] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:03.413866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:03.421945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-822c5232-d4d1-4f87-950a-47eaeddb4d0d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.190339 Jul 21 22:38:03.422600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 218/430] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:03.620597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:03.621773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:03.631900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.632581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:03.633677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:03.634368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.030249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:04.039181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b12d527a-3e98-47d5-98f4-ef20f42dd453 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.431481 Jul 21 22:38:04.039885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 213/431] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:04.339096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:04.339758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:04.346201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.346643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.347988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.348415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.439287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:04.439971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:04.447309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.447819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.448584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:04.449032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:04.498004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:04.507693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bb1e96a1-ac80-4b4f-8ce0-a8af868316a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.172319 Jul 21 22:38:04.508445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 219/432] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:04.665575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:04.673395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b44ec5ab-d64a-4342-9594-982037f3bc2f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.238083 Jul 21 22:38:04.673983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 214/433] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:05.015610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-3ddcd04a-45ab-4d5c-bbdb-c56e89cadf53 req-d5f1ad70-6609-454d-8888-0a140033a06f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02526e73-3f8e-4ab0-a000-79f1250f9be2", "name": "network-vif-plugged", "status": "completed", "tag": "7bff8f72-d3ae-4525-8a5a-82fcdee1ec61"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:05.029544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3ddcd04a-45ab-4d5c-bbdb-c56e89cadf53 req-d5f1ad70-6609-454d-8888-0a140033a06f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.030327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3ddcd04a-45ab-4d5c-bbdb-c56e89cadf53 req-d5f1ad70-6609-454d-8888-0a140033a06f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.055735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-3ddcd04a-45ab-4d5c-bbdb-c56e89cadf53 req-d5f1ad70-6609-454d-8888-0a140033a06f service nova] Creating event network-vif-plugged:7bff8f72-d3ae-4525-8a5a-82fcdee1ec61 for instance 02526e73-3f8e-4ab0-a000-79f1250f9be2 on hv-cinder-85069 Jul 21 22:38:05.064671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-3ddcd04a-45ab-4d5c-bbdb-c56e89cadf53 req-d5f1ad70-6609-454d-8888-0a140033a06f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053046 Jul 21 22:38:05.066164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:05.066549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 220/434] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:05.067200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:05.073790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.074241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.075226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.075674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.228852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:05.240631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-26c96ffc-9b84-4d20-9d7e-fa1108d8cfaf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.179243 Jul 21 22:38:05.241329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 215/435] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:05.528888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:05.529784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:05.538366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.538893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.539790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.540326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.692834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:05.693685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:05.700455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.701263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.702283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:05.702716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:05.712931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:05.725987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-40790d6e-2cbc-4a5f-9b0d-797b32cb2cc8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.202206 Jul 21 22:38:05.726957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 221/436] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:05.906016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:05.916305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de6670a8-6ed7-49b5-9596-383b1b37fcdf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1318 microversion: 2.1 time: 0.228760 Jul 21 22:38:05.917295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 216/437] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:05 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:06.258232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:06.258841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:06.266990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.267754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.269274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.269792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.427129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:06.438636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-da1b7a3d-38e1-488a-95e4-9a8842bdc406 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.184221 Jul 21 22:38:06.439442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 222/438] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:06.744241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:06.744912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:06.751969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.752396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.754338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.754775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.913968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:06.922528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b3296b4c-2f91-46d4-84a2-d735daf2525f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.182443 Jul 21 22:38:06.923107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 217/439] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:06.933700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:06.934314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:06.941882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.942333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:06.943116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:06.943552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.100761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:07.108774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8809bb96-8e8a-47fc-85cd-393404ffbff8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1507 microversion: 2.1 time: 0.178747 Jul 21 22:38:07.109361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:07.126979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e440c591-e7e9-4032-9a46-904ac66c9a6f", "device": "/dev/sdb"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:07.130398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:07.136783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.137243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.138027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.138650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.458026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:07.458784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:07.461611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:07.462819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=12 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:07.469764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.470382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.471167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.471607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.587337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:07.601214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:07.701910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:07.712248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7b515ed7-4008-4116-922e-af41de16abb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.259581 Jul 21 22:38:07.720705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 224/441] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:07.757948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a232c020-17f1-49a5-ae41-0309719e6bf9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "POST /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634741 Jul 21 22:38:07.759195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 218/442] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 22:38:07 2022] POST /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:07.939607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:07.941901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:07.950307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.950817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:07.951697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:07.952168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:08.095919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:08.104917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-656f5cd0-d4ec-4433-bc04-6ab45801f6a0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.169676 Jul 21 22:38:08.105485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 225/443] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:08.731069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:08.731918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:08.739921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:08.740643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:08.741660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:08.742439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:08.993462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:09.001787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-16cd705b-55d0-4b6e-bb96-d82d00d76a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.274828 Jul 21 22:38:09.002199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 219/444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:09.122428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:09.123046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:09.131078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:09.131473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:09.132725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:09.133162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:09.363721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:09.371986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c801f01b-d970-4280-95c2-a0b59fe91b6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.253784 Jul 21 22:38:09.372892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 226/445] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:10.019829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:10.020680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:10.027995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.028594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.029522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.029995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.184701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:10.193727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e9ab1730-19ca-443d-8e5a-80e6a868ace5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.179133 Jul 21 22:38:10.194311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 220/446] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:10.389899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:10.390516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:10.398363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.399071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.400028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:10.400460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:10.404764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:10.679407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:10.689913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-279396c5-af51-4d22-830a-c166260b4eec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.304024 Jul 21 22:38:10.691064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 227/447] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:11.214466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:11.215176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:11.225327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.227729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.229270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.229794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.395997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:11.404647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee5d2303-750b-48bc-8d63-ccc6d1d2ead9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.194102 Jul 21 22:38:11.405580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 221/448] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:11.709295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:11.710505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:11.717559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.718262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.719273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:11.719863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:11.935559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:11.945142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c20d45e1-5ef8-4b55-9137-866c1121980c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.240095 Jul 21 22:38:11.946067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 228/449] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:12.421164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:12.421794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:12.438649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.439095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:12.439895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.441023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:12.609889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:12.619065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3ab3b420-5fb2-47c0-8411-373a319f99ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.201684 Jul 21 22:38:12.629938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 222/450] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:12.965139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:12.965768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:12.980223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.980863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:12.982154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:12.982303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.277732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:13.293198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dbc9a218-5786-40aa-beaa-9523a68a9c52 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.332415 Jul 21 22:38:13.293787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 229/451] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:13.647883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:13.648668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:13.662829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.663330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.664127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:13.665773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:13.860458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:13.877167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-82d36497-616a-4591-8a61-19cfe77167a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.241472 Jul 21 22:38:13.881489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 223/452] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:14.310340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:14.311045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:14.318759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.319718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.320537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.320972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.553968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:14.563020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63713de1-d2d5-4cce-8bbd-21c721f3cb79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.256411 Jul 21 22:38:14.575679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 230/453] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:14.898775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:14.899977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:14.906856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.907320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:14.908199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:14.908676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:15.129512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:15.146372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00886c8c-1303-4a82-84cd-1ff8b91e8531 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.251574 Jul 21 22:38:15.146971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 224/454] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:15.235969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-eaf7f78a-184a-4850-92c0-5b594ab34a3f req-201f4b62-8786-420d-b9b1-ef430f55b84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "name": "network-vif-plugged", "status": "completed", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:15.245397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-eaf7f78a-184a-4850-92c0-5b594ab34a3f req-201f4b62-8786-420d-b9b1-ef430f55b84e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:15.246103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-eaf7f78a-184a-4850-92c0-5b594ab34a3f req-201f4b62-8786-420d-b9b1-ef430f55b84e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:15.260141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-eaf7f78a-184a-4850-92c0-5b594ab34a3f req-201f4b62-8786-420d-b9b1-ef430f55b84e service nova] Creating event network-vif-plugged:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:38:15.265296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-eaf7f78a-184a-4850-92c0-5b594ab34a3f req-201f4b62-8786-420d-b9b1-ef430f55b84e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jul 21 22:38:15.265908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 231/455] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:15.583614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:15.584337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:15.590793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:15.591745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:15.592649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:15.593282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:15.819282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:15.834133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1cce875d-f228-4953-b362-8873bfea545a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.252056 Jul 21 22:38:15.847191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 225/456] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:16.164658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:16.165973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:16.173261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.174036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:16.175838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.176429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:16.387942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:16.398591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-34ed602d-651b-435a-9f1f-bd0572447c92 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.238641 Jul 21 22:38:16.400539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 232/457] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:16.866002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:16.866621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:16.877034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.878145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:16.881728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:16.882724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:17.185198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:17.196516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dd00a7e5-d793-4cc0-a52c-14809c17e1c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.335084 Jul 21 22:38:17.200185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 226/458] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:17.416019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:17.416683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:17.428691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:17.429145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:17.429946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:17.432602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:17.683434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:17.692100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78b76746-b6de-47f2-a345-a9dfe18cd893 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.280611 Jul 21 22:38:17.704624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 233/459] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:18.231508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:18.233181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:18.256884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.257589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:18.258866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.261458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:18.465725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:18.476086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-24bae971-8242-42a3-b12d-4567a39ff655 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.261549 Jul 21 22:38:18.477803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 227/460] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:18.714840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:18.716418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:18.725795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.726717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:18.728944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:18.731753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.052608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:19.061327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0744f0de-835b-4a01-8aab-71ee50dd1f9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.352021 Jul 21 22:38:19.062459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 234/461] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:19.494329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:19.495326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:19.503748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:19.504210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.505159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:19.505805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:19.659932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:19.670011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1b74530d-2eeb-4092-af15-d6347b65cc40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.179803 Jul 21 22:38:19.671474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 228/462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:19.767219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5c22f142-db6b-4eba-b8bb-edf336efe87b tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] Action: 'create', calling method: .version_select at 0x7ff1d8b5ad30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-575535448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIT8l/Lix+Ag/NoWaKYOY90WyGgoY2HkRUzxw1HslUfLSRN9nr6d9dPOObzwBGbOoWNueTRcGqi0grwapGVL9sC+WRapD01YO+hz3S91/SHW6DVxXl8L50VQE+a1RY12Ng=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:19.784011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-5c22f142-db6b-4eba-b8bb-edf336efe87b tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] Getting quotas for project 2387a046193b4ea98ad71ff3a32eb7e8. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:38:19.788280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-5c22f142-db6b-4eba-b8bb-edf336efe87b tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] Getting quotas for user 994c1c9132f146fa84621c6f400f6e8e and project 2387a046193b4ea98ad71ff3a32eb7e8. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:38:19.814017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5c22f142-db6b-4eba-b8bb-edf336efe87b tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.251471 Jul 21 22:38:19.820049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 235/463] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 22:38:19 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:38:20.082537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:20.084945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:20.093374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:20.094084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:20.095691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:20.097988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:20.271398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:20.280328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3625e7e-bdcb-4f6f-b61e-a290ebab5404 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.203797 Jul 21 22:38:20.280953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 229/464] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:20.687351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:20.688303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:20.696176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:20.696679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:20.697474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:20.697912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:20.879117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:20.897483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-10c60be7-10d6-4116-8a2e-a99d2d460de3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.213887 Jul 21 22:38:20.898158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 236/465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:21.297878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:21.299496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:21.305714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.306181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.307073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.307873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.511718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:21.532534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d8d36bbc-05dd-4cd4-a35c-04c5be1d731d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.228808 Jul 21 22:38:21.532534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 230/466] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:21.921169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:21.921785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:21.923536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:21.924591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:21.929169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.929621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.930403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.930838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.930947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.931521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.932300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:21.932775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:21.974377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6a7cbee5-9ed0-4853-a6dd-154651f95d7d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments/60e5a573-ae11-4d95-86c1-946caff08f04" status: 200 len: 194 microversion: 2.20 time: 0.060598 Jul 21 22:38:21.975734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 231/467] 10.222.0.42 () {60 vars in 1453 bytes} [Thu Jul 21 22:38:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments/60e5a573-ae11-4d95-86c1-946caff08f04 => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:22.051132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:22.051635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:22.058453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.058912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.059786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.060256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.104823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:22.115624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-917bdac0-ebea-45a9-84fb-b9c92e320333 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.203756 Jul 21 22:38:22.117054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 237/468] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:22.155544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lazy-loading 'services' on Instance uuid eba1ec2e-bdda-4057-8958-97def6b80299 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:22.234604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-12443abb-07aa-4903-9ca3-98940a5ef975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments/60e5a573-ae11-4d95-86c1-946caff08f04" status: 202 len: 0 microversion: 2.20 time: 0.188020 Jul 21 22:38:22.235230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 232/469] 10.222.0.42 () {60 vars in 1456 bytes} [Thu Jul 21 22:38:22 2022] DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments/60e5a573-ae11-4d95-86c1-946caff08f04 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:38:22.244211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:22.245268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:22.252009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.252884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.254067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.254687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.290473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2d8109ec-bcc1-415c-b068-da4c14114fc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050253 Jul 21 22:38:22.291076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 238/470] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:22.541057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:22.541942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:22.549791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.550250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.551037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:22.551510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:22.710827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:22.713198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:22.720808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-abeafa54-f56c-46a6-a809-be72115f63bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1260 microversion: 2.1 time: 0.183954 Jul 21 22:38:22.721384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 233/471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:23.147671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:23.149289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:23.153997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:23.161285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.162361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.163858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.164585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.303426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:23.304619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:23.311754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.312408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.313387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.313983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.356989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-295d4eaa-c101-4dc7-b03d-49bdf7a8526a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058635 Jul 21 22:38:23.357566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 234/472] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:23.394734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:23.403650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3cd9d483-0f19-4480-b7e8-38d4f7687116 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.263769 Jul 21 22:38:23.404633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 239/473] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:23.740799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:23.742362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:23.748659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.749107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.750126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.750559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.945958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:23.954044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3d4fa772-8bce-423c-983b-e20a58c4ae0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1445 microversion: 2.1 time: 0.218635 Jul 21 22:38:23.954638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 235/474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1445 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:23.972278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:23.972896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:23.985319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.985534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:23.986220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:23.987312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:24.174664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:24.184018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f465c801-d7a9-4d80-9765-18e8a83b313a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1445 microversion: 2.1 time: 0.216046 Jul 21 22:38:24.184996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 240/475] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1445 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:24.372787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:24.374705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:24.390115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:24.390878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:24.393561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:24.394396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:24.421598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:24.422210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:24.435635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:24.436112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:24.436972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:24.437595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:24.463223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-08c368a2-f565-47b8-acbd-56c2ad91f67d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098315 Jul 21 22:38:24.464121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 236/476] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:24.609515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:24.630918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9be5061-982a-47f6-8356-94afa0393136 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.210922 Jul 21 22:38:24.633364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 241/477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:25.475792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:25.476900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:25.484155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.484648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.485435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.486035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.526013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3c1f010b-5fec-487a-b83e-157519d1a2f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054829 Jul 21 22:38:25.526586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 237/478] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:25.651106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:25.651873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:25.658935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.659418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.660174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:25.660709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:25.848768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:25.859151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-62c253a3-b89b-430f-b498-5ff4a7c5031a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.211803 Jul 21 22:38:25.860330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 242/479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:26.538207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:26.539151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:26.541573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=72 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:26.547400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:26.547857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:26.548690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:26.549672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:26.585143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9d5911a-223f-496a-b338-4d487bbd0e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050781 Jul 21 22:38:26.585630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 238/480] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:26.684731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-12116e3d-4ae5-44ca-96ce-757a47e884ee req-a527523a-a9b4-4278-a9c3-377adad890f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:26.698325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-12116e3d-4ae5-44ca-96ce-757a47e884ee req-a527523a-a9b4-4278-a9c3-377adad890f1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:26.698763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-12116e3d-4ae5-44ca-96ce-757a47e884ee req-a527523a-a9b4-4278-a9c3-377adad890f1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:26.713458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-12116e3d-4ae5-44ca-96ce-757a47e884ee req-a527523a-a9b4-4278-a9c3-377adad890f1 service nova] Creating event network-changed:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:38:26.719036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-12116e3d-4ae5-44ca-96ce-757a47e884ee req-a527523a-a9b4-4278-a9c3-377adad890f1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038108 Jul 21 22:38:26.719645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 243/481] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:26.883657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:26.884324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:26.893645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:26.894120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:26.895317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:26.895446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:27.052299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:27.058763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-af7f9925-a573-4545-8f11-3720ce060d62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.184609 Jul 21 22:38:27.059346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:27.598414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:27.599450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:27.606299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:27.606741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:27.607517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:27.607956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:27.646168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aff4c08c-4322-4b29-9ea3-148007dc11f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052703 Jul 21 22:38:27.646764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 244/483] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:28.077645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:28.078386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:28.086197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:28.086645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:28.087425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:28.087865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:28.224959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:28.233164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7f8e7fcc-4182-4d0f-93af-9153d3ef8910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159820 Jul 21 22:38:28.233736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:28.658359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:28.659246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:28.665834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:28.666283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:28.667048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:28.667484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:28.698100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-db7233ae-90ea-4a07-85a7-867d4757299b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Jul 21 22:38:28.698661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 245/485] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:29.251368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:29.252472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:29.259215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:29.259718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:29.260434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:29.260905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:29.411260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:29.420846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aefe6689-7d64-47ca-940a-34c1c36d946e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.173432 Jul 21 22:38:29.421420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 241/486] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:29.710664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:29.711577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:29.718230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:29.718801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:29.719563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:29.719997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:29.725380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:29.751016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a4f8e674-49c9-4865-9134-d18d483952a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044338 Jul 21 22:38:29.751562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 246/487] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:30.439993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:30.441059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:30.449757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.449757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.450417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.450984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.639142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:30.647891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f085fe37-282d-45ab-8a2c-8354a60fd2cf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.212310 Jul 21 22:38:30.648532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 242/488] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:30.766922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:30.770142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:30.773234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:30.784902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.785781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.786820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:30.787261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:30.818220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f9a926b-1202-4a31-aab8-5e670cde5d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058773 Jul 21 22:38:30.818772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 247/489] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:31.666297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.666891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.674468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.674924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.675696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.676123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.825585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:31.830347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.831595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.834838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-709daad9-9e3f-478c-97a8-4539d29beaf1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.172602 Jul 21 22:38:31.835415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 243/490] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:31.838615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.839068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.839853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.840286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.872408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce535d05-68e4-42d5-8ed3-0d2ce8f6ab22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045678 Jul 21 22:38:31.872408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 248/491] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:32.854941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:32.855556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:32.862922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.863374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.864142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.864624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.883847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:32.884806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:32.891211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.891659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.892574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:32.892986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:32.923307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-29bffb91-237b-4a33-8df7-1381db44b63e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043419 Jul 21 22:38:32.927974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 249/492] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:32.999317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:33.008676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-95e49f25-9ae0-4d0e-bcf4-c229eaa99b57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157425 Jul 21 22:38:33.009514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 244/493] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:33.936514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:33.937425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:33.944454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:33.944947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:33.945703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:33.946131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:33.976704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2ac95c31-a21d-4cd8-9c64-259472d0bd5b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Jul 21 22:38:33.977271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 250/494] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:34.027604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:34.028332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:34.035454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.035909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:34.036724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.037166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:34.169635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:34.178845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15f66279-51d2-49d7-b354-6a6603cccb78 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155058 Jul 21 22:38:34.179418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 245/495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:34.988457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:34.989363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:34.995927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.996378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:34.997179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:34.997619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:35.027345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63e3265c-37c6-4e5f-a142-1a5d56869e97 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042936 Jul 21 22:38:35.027890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 251/496] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:35.196465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:35.197167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:35.203581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:35.204026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:35.204819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:35.206011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:35.341683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:35.349776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9a30667-0dd0-40b1-934d-4a3dd68f69dd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157151 Jul 21 22:38:35.350340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 246/497] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:36.039851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:36.041000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:36.048507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.049700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.050420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.050860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.084821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96051c8b-0594-46b0-be7b-fd70e1e9d55f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048829 Jul 21 22:38:36.085315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 252/498] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:36.367178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:36.367707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:36.374282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.374727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.375489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:36.375924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:36.514568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:36.524918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b157cfdd-81b1-4061-a4c4-178b93b9c5d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.161593 Jul 21 22:38:36.525508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 247/499] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:37.097437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.098377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.105007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.105458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.106229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.106668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.137316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f50abf2f-983a-47d6-a2da-a82e559c81bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044072 Jul 21 22:38:37.137545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 253/500] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:37.547336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:37.547940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:37.555101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.555545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.556302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:37.556775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:37.704912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:37.713781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-09df0847-0b00-4a79-b287-f7126e3aab08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.170163 Jul 21 22:38:37.714350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 248/501] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:38.149364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:38.150208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:38.156656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.157100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.157857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.158307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.187243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12191567-2c94-4d69-ad44-afa9bc954423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041863 Jul 21 22:38:38.187785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 254/502] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:38.732581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:38.733187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:38.740601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.741049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.741827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:38.742258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:38.878918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:38.887126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-59dfbfbc-9f82-4f8c-8247-9f231f7e003d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159386 Jul 21 22:38:38.887707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 249/503] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:39.199508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:39.200449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:39.208469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.208946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.209725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.210165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.247404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-835475a0-6ea1-47c0-942b-eb6eface5be5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051789 Jul 21 22:38:39.247999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 255/504] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:39.905356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:39.906218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:39.913056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.915344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.915344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:39.915344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:39.931975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:40.069457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:40.081703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d6a20c85-2c2c-4153-9c76-012d87238336 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.179583 Jul 21 22:38:40.082661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 250/505] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:40.260938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:40.262124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:40.269107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.269549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.270325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:40.270754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:40.302989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-760eb74d-2a10-4317-b67b-a66d83717e5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Jul 21 22:38:40.303570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 256/506] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:41.105859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:41.107193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:41.119034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.119867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.121349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.122163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.296594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:41.311719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-db8c4bbd-dd3e-4a29-a672-b25f377cc11b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.212276 Jul 21 22:38:41.312438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 251/507] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:41.318737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:41.320362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:41.333041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.333491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.334276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:41.334711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:41.368101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-86410112-cba3-4c8b-9665-81fa5db45e42 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056702 Jul 21 22:38:41.368620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 257/508] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:42.337147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:42.337791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:42.344742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.345202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.346397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.346847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.382499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:42.383963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:42.395423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.396228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.397726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:42.398467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:42.450621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-abb143ed-a9a3-4bcf-b3ec-62eb26da980a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074254 Jul 21 22:38:42.451329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 258/509] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:42.499161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:42.509436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f70b9f1c-3e92-42a4-adb5-562bf4498f0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.176495 Jul 21 22:38:42.510038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 252/510] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:43.465022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:43.465949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:43.473700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.474165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.474956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.475394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.509279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6b18a08f-ccdf-4336-939f-6c4ab82fb6ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048277 Jul 21 22:38:43.509868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 259/511] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:43.527530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:43.528174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:43.535167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.535629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.536412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:43.536873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:43.687819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:43.697581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ad18c8cf-1e02-4613-a5f0-85fa25769f90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.174354 Jul 21 22:38:43.698180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 253/512] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:44.521990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:44.522927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:44.529819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.530260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.531029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.531462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.564708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-157bbbcb-6b99-472d-b47f-f1a9f9de668a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047162 Jul 21 22:38:44.565277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 260/513] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:44.725593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:44.726141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:44.733442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.733894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.734688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:44.735128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:44.884719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:44.894265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3c374d24-c761-4a37-9e3a-0b0548a3de62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.174700 Jul 21 22:38:44.894882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 254/514] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:45.577058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:45.578011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:45.585239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.585708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.586482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.586914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.617914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3c97520c-9be8-4cd2-8998-6a0a3a65f879 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044806 Jul 21 22:38:45.618474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 261/515] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:45.911825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:45.912436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:45.919368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.919813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:45.920626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:45.921064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:46.077629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:46.088861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5fc41b61-61a7-4952-8cb5-31e154ed8f8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.180531 Jul 21 22:38:46.089585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 255/516] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:46.630649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:46.631606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:46.638309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:46.638761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:46.639542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:46.639979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:46.667741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:46.673917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb457e7c-87a3-424b-9e9d-ae93369c13b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047452 Jul 21 22:38:46.674503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 262/517] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:47.110282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:47.111705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:47.118626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.119083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.119866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.120300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.270548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:47.285926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-09dbb6d0-91da-420c-b1dd-7db194d2ce83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.179232 Jul 21 22:38:47.286933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 256/518] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:47.687572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:47.688446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:47.696854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.697303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.698082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:47.698515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:47.743766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecdc3994-1144-4ac5-8839-fe3f677906d2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060230 Jul 21 22:38:47.744373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 263/519] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:48.311541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:48.312144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:48.318794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.319245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.320010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.320446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.458413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:48.466515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-29a2518c-cb09-4664-b01e-d1b8879b4c86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.158772 Jul 21 22:38:48.467088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 257/520] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:48.756445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:48.757379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:48.763937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.764382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.765190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:48.765628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:48.796326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5012a586-5112-41cf-b7b3-9287d5c964e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044893 Jul 21 22:38:48.796911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 264/521] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:49.483785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:49.484427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:49.492733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.493266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.494074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.494519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.810460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:49.812105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:49.824703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.825517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.826818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:49.827358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:49.859772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4e6c98d7-666a-4182-b4f9-c1fbb8653696 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056086 Jul 21 22:38:49.862097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 265/522] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:49.918830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:49.928744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4dff7e4f-9259-4b4b-b092-e2ad81bf6952 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.448782 Jul 21 22:38:49.929345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 258/523] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:50.872735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.873724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.881693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.882140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.882921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.883351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.915452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3dc9cdf3-8c8f-4628-88c6-ab4fa192a423 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046858 Jul 21 22:38:50.916033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 266/524] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:50.946705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:50.947332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:50.954805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.955948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:50.956838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:50.957283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.113911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:51.122290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-71cbeb98-2c30-4983-bcc9-a50269b32fa5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.179560 Jul 21 22:38:51.122887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 259/525] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:51.927686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:51.928712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:51.935748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.936278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.937149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:51.937587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:51.974216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-773d195e-9a81-4ec9-9ed4-b686b9ecbe6b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050589 Jul 21 22:38:51.974811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 267/526] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:52.140026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:52.140857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.147592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.148097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.148850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.149287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.347871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:52.356553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fd47a71d-6eec-4770-8e84-20c1229cae7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.220389 Jul 21 22:38:52.357158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 260/527] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:52.986741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:52.988041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.995014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.995467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.996261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.996887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.029817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-76aac5ef-119f-4ca7-af0c-68f6c5c2fd3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047808 Jul 21 22:38:53.030789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 268/528] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:53.384698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:53.385323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:53.394996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.395454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.396538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.397230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.576719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.586261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-caa8d239-9af7-406e-b048-25586304b793 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.205562 Jul 21 22:38:53.586855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 261/529] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:54.043016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:54.043977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:54.046412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=59 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:54.052269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.052749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.053525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.053965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.089119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96a7fd98-93df-4161-b8ca-01a7cae8ede9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050614 Jul 21 22:38:54.089701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 269/530] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:54.611488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:54.612700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:54.624293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.624983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.627393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.628135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.788795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:54.797401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-85da2d1b-b8ca-4b1c-8390-7461ceb85a39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.190576 Jul 21 22:38:54.798369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 262/531] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:55.102468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:55.103532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:55.111724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.112202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.113049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.113496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.149064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f1305713-dd94-42c6-a508-ca9956a5fc29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050632 Jul 21 22:38:55.149646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 270/532] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:55.816306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:55.817177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:55.823772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.824224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.825253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.825929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.966306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.975691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d3f46a0d-3537-4938-8a3f-5e56803f1d53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.163941 Jul 21 22:38:55.976272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 263/533] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:56.319407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.320407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.327236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.327639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.328381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.328928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.362014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6ebb4664-df31-4a53-8c0e-42101b9f025a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.203253 Jul 21 22:38:56.362623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 271/534] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:56.993786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.994486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.997375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:57.007217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.007836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.008803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.009347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.171671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.186639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7cdf6078-f916-4dab-a0dc-27dc60fdb3e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.197139 Jul 21 22:38:57.187231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 264/535] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:57.374426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:57.375264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:57.383227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.383675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.384448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.384912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.422040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e75a1fc0-8ebb-4d66-a333-024fd169c4b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051633 Jul 21 22:38:57.423331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 272/536] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:38:58.206978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:58.207776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.214873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.215328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.216112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.216745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.389220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.400350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2ffb0a8-5cf8-488f-9a9b-3981db6ba4e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.198831 Jul 21 22:38:58.401278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 265/537] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:58.440146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:58.440681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.448165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.448816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.449695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.450254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.483767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-95f9ed59-a0f7-4e4a-a303-c96290b33852 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051821 Jul 21 22:38:58.484367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 273/538] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:59.419823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:59.421847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:59.435212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.436040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.437429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.438260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.496261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:59.497284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:59.505293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.505940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.506530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.507164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.544931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-61c88b27-4f1f-4199-ac2d-cb923f890d08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052848 Jul 21 22:38:59.545529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 274/539] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:38:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:38:59.619207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:59.630231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b32d1e41-f066-4e79-8ac7-7386a28c32f0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.215006 Jul 21 22:38:59.630848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 266/540] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:00.559848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.560827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.568748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.569201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.569994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.570435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.608770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0f1ddb93-08cd-41a2-b351-c3233cca8efc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052862 Jul 21 22:39:00.609245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 275/541] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:00.649882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.651064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.660437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.660934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.661743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.662188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.665242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:00.846749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:00.856763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-99e88676-9002-4717-8fda-ae225c05247e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.211595 Jul 21 22:39:00.857422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 267/542] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:01.622495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:01.623322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:01.631139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.631570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.632367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.633806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.665540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e41c6f4d-adc4-42a7-b427-b37a85b5f3a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047113 Jul 21 22:39:01.666084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 276/543] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:01.876588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:01.877694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:01.886482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.886935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.887714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.888150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.037660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:02.046781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6c0ee41d-4765-46f7-bc47-3387fe3b27c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.174845 Jul 21 22:39:02.048360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 268/544] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:02.679814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.681173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.688800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.689284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.690237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.690674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.723058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-685cc445-89e0-443c-8dfb-df430eab4de1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048823 Jul 21 22:39:02.723643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 277/545] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:03.065013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:03.065692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:03.072573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.073029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.073820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.074291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.204404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:39:03.204690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:39:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 (ip 10.222.0.42) !!! Jul 21 22:39:03.223571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.233054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d2249ef5-7857-4a9c-820c-428e1bad4b66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.171899 Jul 21 22:39:03.233635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 269/546] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:03.735237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:03.736747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:03.743881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.744334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.745149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.745586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.778692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b38453bf-f0dc-4721-b8bd-b685fe7d0a5c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048166 Jul 21 22:39:03.779258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 278/547] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:04.361226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:04.361883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:04.369042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.369533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.370893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.371469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.503175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.511487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4361c136-b017-4e82-ba2b-2d2617bf0663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.264049 Jul 21 22:39:04.512076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 270/548] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:04.791723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:04.792711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:04.799985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.800433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.801232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.801667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.820664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:04.835529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c7ecfb9-69bc-4cc5-9797-2ce124dfde9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047771 Jul 21 22:39:04.836133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 279/549] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:05.528837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:05.529453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:05.536197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.536707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.537477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.537918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.669378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:05.677849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d449af8f-357e-4bae-826b-9b7745248838 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152812 Jul 21 22:39:05.678440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 271/550] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:05.849726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:05.850679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:05.857356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.857801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.858662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.858996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.891824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d2bdfc2-c9c7-407b-bd62-a33a46eebab2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046860 Jul 21 22:39:05.892411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 280/551] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:06.695173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.696022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.702758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.703213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.703999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.704435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.842188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:06.850798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc9f1781-0df5-46b0-a5cf-6b40f643f1f3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159599 Jul 21 22:39:06.851367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 272/552] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:06.903656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.904626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.912309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.912790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.913555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.913992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.943691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-01843010-dc56-4232-9640-f7c687b4f9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044082 Jul 21 22:39:06.944264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 281/553] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:07.867715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.868315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.875020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.876305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.877123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.877565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.956616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.957667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.964278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.964823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.965551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.965981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.995768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d386f374-1989-4c6b-a43a-eabd17559984 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044180 Jul 21 22:39:07.996325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 282/554] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:08.009619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.018325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a11d302e-de72-4e39-9aa0-1ad386ce6e4d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154459 Jul 21 22:39:08.018882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 273/555] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:09.008037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.008974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.015466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.016510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.017273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.017699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.035822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.036432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.043442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.043900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.044732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.045174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.048568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c8e8a1a-580e-4f47-9895-de4794108e78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044437 Jul 21 22:39:09.049147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 283/556] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:09.202610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.212318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2966ea8-cc67-4c44-a582-97149a576ff4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.180381 Jul 21 22:39:09.212934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 274/557] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:10.060790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.061705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.069167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.069603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.070381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.070812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.103127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92634198-1ee3-44f9-b552-e318d198702a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046310 Jul 21 22:39:10.103711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 284/558] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:10.230872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.231486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.238820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.239272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.240055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.240521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.393034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:10.401470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b15574ef-cace-45c7-a929-340ba4aac048 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.174325 Jul 21 22:39:10.402051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 275/559] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:11.116216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:11.117192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.124500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.125481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.126553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.126988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.161418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08091a8a-d722-41fa-b77b-4c167e4dca4e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049130 Jul 21 22:39:11.162018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 285/560] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:11.425272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:11.426184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.433192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.433648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.434678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.434920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.638480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:11.648187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f78d7a2e-2fcb-4b62-afd1-af472d5f66b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.227932 Jul 21 22:39:11.648814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 276/561] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:12.174043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.174981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.181713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.182163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.182944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.183404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.217682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d457c1f1-1846-4cca-a26c-38fb22bb551c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048351 Jul 21 22:39:12.218350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 286/562] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:12.666313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.666953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.674644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.675090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.675864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.676297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.824428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.833559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cf8d4946-4cb0-40d1-bdfd-845357ac6e30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.170984 Jul 21 22:39:12.834203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 277/563] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:13.232789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:13.233783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:13.241724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.242175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.242958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.243394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.277914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-56a6dbd6-c635-4725-a935-642c33582638 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050956 Jul 21 22:39:13.278478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 287/564] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:13.851063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:13.851739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:13.858706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.859468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.860310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.860782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.010623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.019676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-496e82fe-d63d-4751-bbf7-957cfe89eb48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.172417 Jul 21 22:39:14.020269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 278/565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:14.290512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:14.291442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:14.299896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.300348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.301252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.301687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.348257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-02adaa5e-3629-468c-88e2-dcc95df3c74f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061801 Jul 21 22:39:14.348920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 288/566] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:15.037041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.037650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.044408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.044899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.045675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.046113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.185155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:15.194525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-43a12e17-dc82-453e-af82-3c3c1b18c78b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1716 microversion: 2.1 time: 0.161291 Jul 21 22:39:15.195114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 279/567] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:15.256024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.256546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.262981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.263426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.264343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.264808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.360355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.361403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.367971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.368422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.369239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.369679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.404360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c093c629-b5e6-418c-8f09-0a7b9992a8a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048812 Jul 21 22:39:15.405001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 280/568] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:15.564684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] HTTP exception thrown: Cannot 'detach_volume' instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 while it is in vm_state rescued Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Request method failure captured: Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments/be9a2446-ac07-4d36-b75e-d3eab2d1bafb HTTP/1.1 Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRa1aevr8hfzH9tBnuI-nZ1o2-tjU0GUNavGBtGQWU6Bs5pOzyJHT4Skp5b3-0DBBU3X8C68BEsgTbyQezGagdfLsbdMxTPByDRQyFIC1JVM9KlTtTt--Zk_zhn_jbNU9KTZSYXlKXSPLUxJPykAXr1INDiMeiVGu8oNVWZ5LpTsug Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 0b2f768290ea43cb98b058067268674d Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:39:15.566428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b2f768290ea43cb98b058067268674d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b2f768290ea43cb98b058067268674d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 0b2f768290ea43cb98b058067268674d Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: f93bd44f2fbc4be4be905c8b8ae0e343 Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:39:15.569576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Cannot 'detach_volume' instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 while it is in vm_state rescued Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': '5a0581a2-5f0c-492d-8051-d7a05bc96786', 'id': 'be9a2446-ac07-4d36-b75e-d3eab2d1bafb'} Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:15.570988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 while it is in vm_state rescued Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 while it is in vm_state rescued Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:39:15.574177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Returning 409 to user: Cannot 'detach_volume' instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 while it is in vm_state rescued {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:15.576943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6e1172e5-c630-4b2f-bd1a-e167681085d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments/be9a2446-ac07-4d36-b75e-d3eab2d1bafb" status: 409 len: 152 microversion: 2.1 time: 0.316142 Jul 21 22:39:15.576943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 289/569] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:39:15 2022] DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments/be9a2446-ac07-4d36-b75e-d3eab2d1bafb => generated 152 bytes in 318 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:39:15.582319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:15.583341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.595430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.596263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.597751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.598532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.682838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d7fafeb7-5c94-4be7-bd25-34acc26f6832 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action" status: 202 len: 0 microversion: 2.1 time: 0.108672 Jul 21 22:39:15.683712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 281/570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:39:15 2022] POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:39:15.694397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.695117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.702244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.703316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.704454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.704934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.855706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:15.865272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46a596c1-25bb-4373-8957-42d3150b381a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1724 microversion: 2.1 time: 0.175833 Jul 21 22:39:15.865847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 290/571] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:16.424367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.425468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.432037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.432512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.433306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.433744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.473459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:16.482543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-56b2e3b6-11ca-4b67-9be4-8edd63b52429 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063508 Jul 21 22:39:16.483133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 282/572] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:16.885651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.886669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.897811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.898794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.899976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.900731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.078446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.087195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aadc194d-9cbb-4c8d-b1b7-ff5dbe55374d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1724 microversion: 2.1 time: 0.206778 Jul 21 22:39:17.087938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 291/573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:17.495430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:17.496269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:17.504303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.504782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.505581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.506013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.538911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7d4e8e59-3746-48d5-9ae5-0e40d0b31afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047505 Jul 21 22:39:17.539486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 283/574] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:18.106681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:18.107328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:18.115259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.115714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.116526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.116972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.273907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:18.283957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f44b6bb4-f6c8-4616-8f6a-863ab4f6f282 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1724 microversion: 2.1 time: 0.181273 Jul 21 22:39:18.284607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 292/575] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:18.551938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:18.552934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:18.560054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.560643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.561496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.562553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.601633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5d6531d1-7f0f-481e-9ec7-6101e7a5c2b6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053877 Jul 21 22:39:18.602239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 284/576] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:19.310508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:19.311240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:19.319376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.319831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.320659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.321100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.509687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:19.519305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5c740049-bc43-4727-ace2-45945a5333dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1724 microversion: 2.1 time: 0.213157 Jul 21 22:39:19.519895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 293/577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:19.618911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:19.620589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:19.633996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.634789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.636190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.637006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.674816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f5a0c6a2-c0c7-4a41-9151-3f3889271ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063522 Jul 21 22:39:19.675300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 285/578] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:20.538179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:20.538827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:20.545842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.546598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.547448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.547883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.688027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:20.689232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:20.696807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.697266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.698061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.698500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.698644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.714780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5c24d4a8-08fc-4d12-b9e5-0508051ad133 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1730 microversion: 2.1 time: 0.180091 Jul 21 22:39:20.715800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 294/579] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:20.734345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2a909dea-1bbb-43da-ac7b-0d354fbb2c73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050733 Jul 21 22:39:20.735385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 286/580] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:20.739422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:20.740290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:20.752427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.753233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.754618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.755363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.875429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8b40cf0-176b-4f3c-aaf6-e0137926fdcb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143914 Jul 21 22:39:20.876629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 295/581] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 22:39:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:39:21.752422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:21.753991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:21.766087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.766892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.768553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.769297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.812841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bba65598-59e7-4dd8-b367-b8fd8aaadd40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068464 Jul 21 22:39:21.813797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 287/582] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:22.222539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-3697edf6-680b-4744-88cb-103ea0f7d61e req-3c501511-abbd-45c0-8c3d-a0e15d082092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:22.242817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3697edf6-680b-4744-88cb-103ea0f7d61e req-3c501511-abbd-45c0-8c3d-a0e15d082092 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.244133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-3697edf6-680b-4744-88cb-103ea0f7d61e req-3c501511-abbd-45c0-8c3d-a0e15d082092 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.271276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-3697edf6-680b-4744-88cb-103ea0f7d61e req-3c501511-abbd-45c0-8c3d-a0e15d082092 service nova] Creating event network-changed:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 22:39:22.279456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-3697edf6-680b-4744-88cb-103ea0f7d61e req-3c501511-abbd-45c0-8c3d-a0e15d082092 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062615 Jul 21 22:39:22.281354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 296/583] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:22.826599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:22.829654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:22.837205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.837664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.838701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.839146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.878632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c37c42e8-be0b-4905-afa6-df5bdd8c42c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057032 Jul 21 22:39:22.879622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 288/584] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:23.896357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:23.897413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:23.903690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.904158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.904953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.905405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.909477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.935864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-771440cf-7682-406c-a69d-53766c520658 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045769 Jul 21 22:39:23.937217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 297/585] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:24.354677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-b528ca3b-334f-44d9-bcaa-264d61cde328 req-5168329e-c42a-422f-882a-6ad4f49dc738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:24.363691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b528ca3b-334f-44d9-bcaa-264d61cde328 req-5168329e-c42a-422f-882a-6ad4f49dc738 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.364136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b528ca3b-334f-44d9-bcaa-264d61cde328 req-5168329e-c42a-422f-882a-6ad4f49dc738 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.376348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-b528ca3b-334f-44d9-bcaa-264d61cde328 req-5168329e-c42a-422f-882a-6ad4f49dc738 service nova] Creating event network-changed:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 22:39:24.381482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-b528ca3b-334f-44d9-bcaa-264d61cde328 req-5168329e-c42a-422f-882a-6ad4f49dc738 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088938 Jul 21 22:39:24.382087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 289/586] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:39:24.949057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:24.949988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:24.953755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=58 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:24.960910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.961473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.962494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.963069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.003829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7e6e12e9-81af-482c-a39d-abdda4f80e22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058952 Jul 21 22:39:25.004443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 298/587] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:26.017302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:26.018307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:26.024706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.025163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:26.025928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.026362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:26.057657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5e172886-896a-4636-833b-223086d27826 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045868 Jul 21 22:39:26.058230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 290/588] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:27.070269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:27.071139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:27.079198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.079645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.080427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.080886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.113049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4350de7a-99be-4131-b987-76378fb31337 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046763 Jul 21 22:39:27.113610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 299/589] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:28.126459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:28.127434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:28.130097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=54 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:28.136004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.136496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.137290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.137729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.175121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e265940f-6118-4d4d-8189-05dc86c5741a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053022 Jul 21 22:39:28.176207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 291/590] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:29.187747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:29.188594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:29.195014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.195458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.196215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.196667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.225053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70f599f7-bfbe-43e2-b686-ea443595fc67 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041420 Jul 21 22:39:29.225595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 300/591] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:30.237575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:30.238495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:30.248601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.248601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.248601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.248601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.277339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-541b3a03-3e10-46ce-b7a7-69cb4343c891 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043930 Jul 21 22:39:30.277894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 292/592] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:31.289534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:31.290475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:31.297195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.297648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.298399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.298830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.330027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4c98664a-f1cc-4537-99d5-a8138773d8f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044167 Jul 21 22:39:31.330627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 301/593] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:32.342052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:32.343002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:32.350075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.350521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.351284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.351720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.381236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-36d59847-6952-4ea1-a16c-962115082ae9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043179 Jul 21 22:39:32.381798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 293/594] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:33.393836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:33.394828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:33.401981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:33.402428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:33.403216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:33.403660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:33.441345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-881f9c4e-7cec-4fc2-8dff-e1236f9600c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051863 Jul 21 22:39:33.441943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 302/595] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:34.454990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:34.455932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:34.462478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.462924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.463684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.464114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.492830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-177fa2f1-147a-4ef6-ba55-66b8c6830ed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042445 Jul 21 22:39:34.493387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 294/596] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:35.504983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:35.505930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:35.512598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:35.513048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:35.515633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:35.515633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:35.545816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-51c9d6a9-05e4-4414-9e77-3389660d4c40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045636 Jul 21 22:39:35.546381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 303/597] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:36.558517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:36.559442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:36.566571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:36.567023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:36.567795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:36.568236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:36.599706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-599c7027-142f-47f0-a3fa-27b1edd4b8d6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045149 Jul 21 22:39:36.600243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 295/598] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:37.612469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:37.613406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:37.620140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:37.620619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:37.621383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:37.621812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:37.653234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-123bd617-f2ef-4e9b-835a-5e242a11814f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045478 Jul 21 22:39:37.653807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 304/599] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:38.667083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:38.668018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:38.675494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:38.675953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:38.676747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:38.677193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:38.708223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c000c9e8-2206-4c89-86c4-d86598570a4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046207 Jul 21 22:39:38.708834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 296/600] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:39.720601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:39.721421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:39.728049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:39.728600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:39.729290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:39.729721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:39.761749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-38cdc171-5332-4d9d-90e3-284865a00497 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045181 Jul 21 22:39:39.762309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 305/601] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:40.775509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:40.776360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:40.783435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:40.783967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:40.784712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:40.785143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:40.817689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8db59503-366d-475e-8c87-956f0ba523a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046810 Jul 21 22:39:40.818287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 297/602] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:41.829808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:41.830738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:41.837332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:41.837772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:41.838568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:41.839000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:41.869940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-def6a010-89f6-4534-a60a-b4428a1ec5f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044207 Jul 21 22:39:41.870505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 306/603] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:42.881136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:42.882058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:42.888612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:42.889063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:42.889828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:42.890262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:42.919867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dac514b4-6026-4c2a-aede-8943aaff926e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042645 Jul 21 22:39:42.920412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 298/604] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:43.932212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:43.933324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:43.941629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:43.941629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:43.942058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:43.943171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:43.973632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2300fc90-2472-4d16-9d02-576cbd13b11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Jul 21 22:39:43.974208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 307/605] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:44.985579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:44.986528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:44.993123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:44.993578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:44.994348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:44.994815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:45.025256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4359aed8-48fa-4874-88bb-0eca5042b195 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043684 Jul 21 22:39:45.025824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 299/606] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:46.037448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:46.038402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:46.045214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:46.045686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:46.046452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:46.046893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:46.078933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-203b1a57-ece5-4caa-9706-23b4536cf2df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045677 Jul 21 22:39:46.079498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 308/607] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:47.091894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:47.092754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:47.099382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:47.099828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:47.100691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:47.101128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:47.103611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:47.132689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c06f4169-e787-4ba8-9300-900e4f536aac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044842 Jul 21 22:39:47.133246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 300/608] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:48.145550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:48.146569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:48.153178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:48.153624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:48.154382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:48.154815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:48.183831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-769a4842-f451-47cd-bf77-390be27691a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043661 Jul 21 22:39:48.184382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 309/609] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:49.196919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:49.197845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:49.204469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:49.205060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:49.206065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:49.206497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:49.238349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a8fdc3e0-db95-4fa2-9cb7-763046e5f267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045534 Jul 21 22:39:49.238936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 301/610] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:50.250583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:50.251439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:50.258122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.258561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.259323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:50.259756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:50.290126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc776bb3-8bb1-4aef-806a-0851b11ff238 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043828 Jul 21 22:39:50.290693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 310/611] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:51.302815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:51.303832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:51.310412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.310858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.311621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:51.312070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:51.359493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4ef3853e-7bd2-4a4b-810d-a010c82d586a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061344 Jul 21 22:39:51.360348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 302/612] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:52.371606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:52.372577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:52.380736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:52.381188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:52.381961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:52.382396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:52.413359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cca78860-19ca-4324-98fe-09a619bbd3c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045724 Jul 21 22:39:52.413939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 311/613] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:53.426807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:53.427877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:53.434345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:53.434799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:53.435575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:53.436013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:53.467596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-acdacb1b-3bb7-470e-8df9-76abfaf90975 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045547 Jul 21 22:39:53.468165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 303/614] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:54.480010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:54.481021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:54.489199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:54.489741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:54.490482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:54.490955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:54.493818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=89 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:54.523930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3e15c167-6573-4ff0-bcc5-f76d5d57ea39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047842 Jul 21 22:39:54.524406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 312/615] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:39:55.536804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:55.538591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:55.545893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:55.546345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:55.547127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:55.547559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:55.580856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d101a8bb-51bc-4aeb-87ba-df49b6d8e068 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049021 Jul 21 22:39:55.581536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 304/616] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:56.593279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:56.594208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:56.596906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=30 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:56.602353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:56.602804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:56.603576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:56.604078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:56.636914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37d7a888-e710-49b2-9220-e4c7f996e2bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047527 Jul 21 22:39:56.637486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 313/617] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:57.649159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:57.650190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:57.656852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.657299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.658059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:57.658486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:57.694158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9d4b7e1f-357c-43a3-b1fd-097f00fab498 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048653 Jul 21 22:39:57.695206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 305/618] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:58.711050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:58.713660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:58.724530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.724966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.725756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:58.726193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:58.760163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4d80a486-cc8a-44e9-95c6-beabcb46e916 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057176 Jul 21 22:39:58.760777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 314/619] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:39:59.772652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:59.773503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:59.776001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=30 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:59.781549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.782004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.782787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:59.783235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:59.813533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0c3d0f11-5141-421a-85ba-79f45d1f5fed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045588 Jul 21 22:39:59.814136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 306/620] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:39:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:00.826618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:00.827560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:00.835234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:00.835681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:00.836501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:00.836947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:00.869428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-60badc6f-1fa2-4d8d-9e4f-5c76f19de531 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047007 Jul 21 22:40:00.870020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 315/621] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:01.883466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:01.884402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:01.891242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:01.891697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:01.892500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:01.892940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:01.925685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8ed17fc0-6242-4a98-9427-c817a41651ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046748 Jul 21 22:40:01.926271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 307/622] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:02.938092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:02.939032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:02.946857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:02.947310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:02.948107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:02.948586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:02.982732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b8c2bb07-6f10-4026-a2aa-5c944837328e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048640 Jul 21 22:40:02.983321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 316/623] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:03.465577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:03.466464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:03.478272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.479089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.480458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.481289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.602851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lazy-loading 'services' on Instance uuid 5a0581a2-5f0c-492d-8051-d7a05bc96786 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:40:03.700467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b88a6724-1531-42f4-97a9-d70c084f5146 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments/be9a2446-ac07-4d36-b75e-d3eab2d1bafb" status: 202 len: 0 microversion: 2.1 time: 0.241776 Jul 21 22:40:03.701124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 308/624] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:40:03 2022] DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments/be9a2446-ac07-4d36-b75e-d3eab2d1bafb => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:40:03.710059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:03.710995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:03.717462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.717941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.718728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:03.719167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:03.752203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0b2e8ec8-43ce-4fed-a058-f95c9e284b8b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Jul 21 22:40:03.753601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 317/625] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:03.995756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:03.996807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:04.004314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.004794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.005578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.006015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.038605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-27e24822-088e-4f1b-bcef-c30c0a3f645e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047352 Jul 21 22:40:04.039189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 309/626] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:04.766188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:04.767053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:04.779413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.779413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.779413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:04.779413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:04.813147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9a814cf-285d-4e46-bf8d-f0c6dac8aee7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051162 Jul 21 22:40:04.813744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 318/627] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:05.051593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:05.052542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:05.059103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.059548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.060330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.060804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.090234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-59eb3070-9728-4a34-8290-82433c63e8b0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043681 Jul 21 22:40:05.090808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 310/628] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:05.825112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:05.826032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:05.832815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.833267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.834029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:05.834464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:05.864092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ca5105d9-212b-4083-bb7c-3dbbebf1901b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 21 22:40:05.864688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 319/629] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:06.103275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:06.104106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:06.110701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:06.111151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:06.111984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:06.112415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:06.146389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eaed118a-9975-4cbf-8316-46fbbf6c5e9c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Jul 21 22:40:06.146985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 311/630] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:06.875295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:06.876219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:06.883368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:06.883812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:06.884598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:06.885036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:06.913308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6205375-4478-427b-9277-6a5436494541 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042196 Jul 21 22:40:06.913855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 320/631] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:07.157929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:07.159093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:07.166094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.166539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.167308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.167741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.199653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-893c1eb2-d0d7-4737-ae45-b91dafc708bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045758 Jul 21 22:40:07.200214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 312/632] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:07.924932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:07.925851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:07.932278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.932764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.933523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:07.933965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:07.963186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b10473cd-4f42-43ba-97c2-48fe8520fd91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042248 Jul 21 22:40:07.963743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 321/633] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:08.212295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:08.213174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:08.219800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.220248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:08.221074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.221541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:08.254060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9f2d38b7-1d58-451c-a659-0f839ad1ac37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045908 Jul 21 22:40:08.254648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 313/634] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:08.974870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:08.975803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:08.982300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.982756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:08.983524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:08.983961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.013614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-90aadf52-bc56-4226-be1e-27e62b742a93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043355 Jul 21 22:40:09.014175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 322/635] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:09.266450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:09.267395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:09.275151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.275594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.276415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:09.276911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:09.310749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c475983b-150f-49de-b4ef-f5ec66ca246f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048281 Jul 21 22:40:09.311270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 314/636] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:10.025266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.026217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:10.032690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.033137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.034472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.034904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.063003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-66c9aae2-12a8-40be-b63c-b0dc9e4eb671 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Jul 21 22:40:10.063544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 323/637] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:10.322534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:10.323452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:10.330853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.331474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.332324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:10.332785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:10.363482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c0f5c770-5630-467b-ab44-a4626a8962ab tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Jul 21 22:40:10.364033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 315/638] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:11.075460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:11.076354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:11.083968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.084415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.085239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.085682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.119526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2a681054-5ae4-43a5-89f9-1db668eb4607 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048521 Jul 21 22:40:11.120117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 324/639] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:11.375794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:11.376695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:11.383570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.384017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.384857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:11.385297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:11.387914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:11.418606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2fb004ed-c217-4cb2-bb56-7d41edb2c733 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047086 Jul 21 22:40:11.419206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 316/640] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:12.133430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.134543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:12.141920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:12.142570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:12.143367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:12.144016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:12.176780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ef136bf1-e97f-463e-9160-055377777307 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Jul 21 22:40:12.177378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 325/641] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:12.433076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:12.434602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:12.443226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:12.443677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:12.444461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:12.444929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:12.478763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9ede4cb6-84ba-4e00-ac69-9c8cf27de987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051905 Jul 21 22:40:12.479346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 317/642] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:13.188925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:13.190051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:13.197112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.197558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.198328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.198758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.230475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fcd5ccb4-b5b6-4c7f-a913-87d93a0ef79d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Jul 21 22:40:13.231079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 326/643] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:13.491538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:13.492413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:13.499502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.499946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.500751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:13.501183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:13.535619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a3e3ec10-6f7f-4117-b968-e35037acaf3b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048786 Jul 21 22:40:13.536200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 318/644] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:14.242942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:14.243840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:14.251008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.251448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.253162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.253651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.286061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7d6372e7-adc3-4008-b904-94c15a0407f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047103 Jul 21 22:40:14.286656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 327/645] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:14.547594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:14.548561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:14.556188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.556688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.557481 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:14.557923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:14.591410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-502cda00-33bf-4a30-9efc-2fdd48e58eca tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047778 Jul 21 22:40:14.592001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 319/646] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:15.298074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:15.299581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:15.306163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.306606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.307374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.307807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.333071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:15.339810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-894135e6-0967-44dc-bf13-a1c1b8b2d156 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Jul 21 22:40:15.340384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 328/647] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:15.603454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:15.604472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:15.612808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.612808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.613409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:15.613845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:15.645384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a1242133-25fd-4967-86b7-7975eae28e91 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Jul 21 22:40:15.645960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 320/648] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:16.352138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:16.353115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:16.359913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.360369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.361195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.361636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.396958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0ec08311-4f12-4ff3-a36b-4001285ed292 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048988 Jul 21 22:40:16.397566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 329/649] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:16.657745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:16.658980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:16.665425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.665860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.666640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:16.667078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:16.698642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-76ac9278-d195-4214-85b9-48aa58d3172e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Jul 21 22:40:16.699205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 321/650] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:17.409149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:17.410185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:17.417322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.417768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.418537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.418965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.453131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-17b3125a-9875-4547-aca6-4a4a059255f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048505 Jul 21 22:40:17.453725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 330/651] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:17.712258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:17.713304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:17.721118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.721580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.722379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:17.722824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:17.755437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ada6d07b-4d38-4470-8534-c6795965e76a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047192 Jul 21 22:40:17.756261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 322/652] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:18.465834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:18.466765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:18.475502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.476169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.477611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.478438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.515736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7e5194b3-7c1e-4d76-9500-33b5dc13ef6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053905 Jul 21 22:40:18.516331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 331/653] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:18.769662 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:18.770506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:18.779253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.779841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.781179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:18.781879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:18.823385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0eb26495-f4d7-47d4-8916-a2ad90ffc7ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057824 Jul 21 22:40:18.823999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 323/654] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:19.528792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:19.529737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:19.536661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.537110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.537891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.538319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.570250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a7a4ede2-e323-48c3-bddc-7209ea51bd4e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Jul 21 22:40:19.570822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 332/655] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:19.836091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:19.837100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:19.844301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.844793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.845655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:19.846102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:19.880827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-859c22dc-e7a4-49b2-9412-73bbaa0ba802 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048814 Jul 21 22:40:19.881784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 324/656] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:20.582931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:20.584229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:20.591117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.591565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.592348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.592820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.625109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0f023e6b-9a74-42a0-8b32-5cc81381b22a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Jul 21 22:40:20.625716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 333/657] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:20.896237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:20.897365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:20.904753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.905214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.906051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:20.906561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:20.941407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-45fc9a45-5b53-4f50-9485-63167ff2ef7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049926 Jul 21 22:40:20.942219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 325/658] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:21.649057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:21.649915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:21.657010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.657457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.659036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.659479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.699959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32284a33-9b29-423e-931a-5646407b885a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054302 Jul 21 22:40:21.701288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 334/659] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:21.954298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:21.955893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:21.962666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.963149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.963946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:21.964388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:21.997709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4dc6bf89-4a48-4ac9-a679-a6ecd550cbf2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047674 Jul 21 22:40:21.998299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 326/660] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:22.713814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:22.714649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:22.721963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:22.722404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:22.723178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:22.723611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:22.754305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9be70dde-e8d2-4a68-ac2e-a72ca55cbf6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Jul 21 22:40:22.754891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 335/661] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:23.010362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:23.011189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:23.018495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.018939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.019710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.020155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.050393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3bb80cb1-ab0a-4236-aeaa-c236d3de62da tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044061 Jul 21 22:40:23.050965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 327/662] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:23.766171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:23.767633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:23.774253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.774700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.775462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:23.775896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:23.804046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8232e1c2-2bee-4132-90da-2f79140f766b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jul 21 22:40:23.804620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 336/663] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:24.062742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:24.064345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:24.071187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.071630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.072388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.072848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.102049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fc455120-74ba-42a7-91c0-91a8d8769a10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043251 Jul 21 22:40:24.102607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 328/664] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:24.816178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:24.817126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:24.823653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.824095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.824875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:24.825312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:24.854806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1bdc5d66-9625-407e-bd0d-48eea08fe0e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042711 Jul 21 22:40:24.855353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 337/665] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:25.113973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:25.114814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:25.121385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.121839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.122606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.123048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.153240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd190c0d-8f42-4b25-80fe-847136678db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043431 Jul 21 22:40:25.153807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 329/666] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:25.867380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:25.868306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:25.875237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.875661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.877104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:25.877650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:25.909198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-991356fd-3a82-4105-a886-5f0454fd11c2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Jul 21 22:40:25.909774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 338/667] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:26.165321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.166212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:26.173158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.173436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.174203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.174663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.205710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-498cd852-eecb-4fce-82e5-9408b87f4ab9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044451 Jul 21 22:40:26.206232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 330/668] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:26.741811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:26.742252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:26.744151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:26.750034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.750484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.751470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.752085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.775712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lazy-loading 'flavor' on Instance uuid 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:40:26.847303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-85c079bd-64cf-4ff5-a28f-ecb298303d14 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "POST /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9/action" status: 202 len: 0 microversion: 2.1 time: 0.109385 Jul 21 22:40:26.847899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 339/669] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:40:26 2022] POST /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:40:26.856079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.856724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:26.864197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.864681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.865452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.865887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.921919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:26.923016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:26.930018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.930461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.931225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:26.931654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:26.963669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-40c61447-9814-4947-98ed-42d1e0a59950 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046381 Jul 21 22:40:26.964241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 340/670] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:27.003259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:27.010756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b7d23038-6313-4aab-b222-91037fe5c4e8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158601 Jul 21 22:40:27.011342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 331/671] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:27.218088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:27.219051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:27.226261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.226777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.227523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.227921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.260964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c97e631c-83f5-470c-989c-835cb2d151bf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047118 Jul 21 22:40:27.261464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 341/672] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:27.975344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:27.976310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:27.983214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.983664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:27.984442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:27.984920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:28.012208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:28.017722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef3ca8ce-d702-4183-906d-856691f73599 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Jul 21 22:40:28.018314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 332/673] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:28.027392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:28.027996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:28.034857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:28.035294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:28.036186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:28.036653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:28.175585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:28.183240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ad3f37ba-58f4-4a05-bfce-e67e22e46b7c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159712 Jul 21 22:40:28.183813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 342/674] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:28.273071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:28.273904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:28.280285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:28.280770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:28.281550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:28.281992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:28.314001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-08a2d2b0-d24b-41e7-844b-3afc005eb87b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044938 Jul 21 22:40:28.314627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 333/675] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:29.029517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:29.030465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:29.037369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.037824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.038610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.039047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.053568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:29.073776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3bd0d284-5edd-4c00-8bf5-5cee0514680f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048152 Jul 21 22:40:29.074265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 343/676] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:29.209069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:29.209667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:29.216246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.216751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.217500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.217931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.326234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:29.327387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:29.333754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.334304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.335163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:29.335704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:29.357114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:29.366431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1646dd04-c2f9-4a50-aacb-e847aa536513 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161077 Jul 21 22:40:29.367112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 334/677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:29.370201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-60325feb-8ecb-4b1c-8e71-69cec26b5bfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048553 Jul 21 22:40:29.370933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 344/678] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:30.086734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.087692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.089593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=58 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:30.095751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.096202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.096998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.097459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.127166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7b3407ba-c6b3-4ba4-929f-688c760339e1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Jul 21 22:40:30.127728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 335/679] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:30.382447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.383418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.384339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:30.385011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:30.390033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.390474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.391241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.391454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.391683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.391860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.393232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:30.393629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:30.431822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-98b26b4d-816c-4f0d-95fb-73b8b4dc5ba6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051505 Jul 21 22:40:30.431822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 345/680] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:30.553410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:30.567370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dc1cf261-4b91-40bb-a0c9-f8995fb86603 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.186307 Jul 21 22:40:30.568427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 336/681] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:31.139377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:31.140215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:31.146500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.146949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.147716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.148150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.179136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d8ff194f-8128-43dc-b5d4-6fb782fe49b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Jul 21 22:40:31.179699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 346/682] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:31.443103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:31.444032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:31.450730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.451180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.451953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.452389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.489240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-93e8342c-abbd-4afa-8a39-a3085ce85b07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050609 Jul 21 22:40:31.490009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 337/683] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:31.586222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:31.586832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:31.593467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.593916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.594687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:31.595129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:31.741175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:31.749866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8caf76be-17ea-4444-a08e-55285eaaecb7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167630 Jul 21 22:40:31.750446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 347/684] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:32.191619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:32.192578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:32.198992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.199429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.200216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.200691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.232699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5da4aced-d671-46df-879a-c08e0d793a91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Jul 21 22:40:32.233274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 338/685] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:32.502904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:32.503708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:32.509862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.510306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.511066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.511494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.542407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6184c616-8a04-4ecc-92fd-311019de5794 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044013 Jul 21 22:40:32.542976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 348/686] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:32.768577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:32.769135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:32.776019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.776470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.777292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:32.777733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:32.922799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:32.931423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-acf89405-7cc3-4f8c-92b7-010ad2609675 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167639 Jul 21 22:40:32.932001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 339/687] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:33.245081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:33.245999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:33.253985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.254431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.255194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.255626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.290456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1f1de4ac-85fe-4ed6-898a-757f29c57a27 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049292 Jul 21 22:40:33.291057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 349/688] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:33.555345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:33.556268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:33.562403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.562850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.563610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.564117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.592969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d1d72115-99cb-48b1-ae87-31211b0ce0d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041594 Jul 21 22:40:33.593540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 340/689] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:33.949860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:33.950372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:33.956936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.957372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:33.958176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:33.958606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.105546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:34.113299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-228e22a2-58ff-45fd-92d1-4da7b5917168 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167474 Jul 21 22:40:34.113893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 350/690] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:34.303486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:34.304552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:34.311217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.311677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.312486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.312927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.347018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3cd5abd0-605b-4d5c-833a-2a9fc2404415 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048133 Jul 21 22:40:34.347604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 341/691] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:34.605473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:34.606332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:34.613443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.613888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.614642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:34.615257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:34.648269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-33ce1fff-02d6-489f-a86c-8975f7519456 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046879 Jul 21 22:40:34.649117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 351/692] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:35.131301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:35.131920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:35.138629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.139760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.140859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.141360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.278537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:35.287891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4de25c2b-19e6-49f5-b23c-c436baa13808 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160681 Jul 21 22:40:35.288496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 342/693] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:35.363163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:35.364261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:35.370544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.370989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.371756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.372191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.403913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a18e88af-39b3-4203-bedc-7cbe6d7deea3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045678 Jul 21 22:40:35.404397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 352/694] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:35.661908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:35.662766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:35.669543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.669997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.670850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:35.671327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:35.706039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a5ad200a-86fb-41f3-bd69-4191f30c542b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049860 Jul 21 22:40:35.707368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 343/695] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:36.305408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:36.306020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:36.313291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.313756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.314512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.314946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.416532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:36.417468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:36.423791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.424245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.425252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.425528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.446875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:40:36.447151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:40:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments (ip 10.222.0.42) !!! Jul 21 22:40:36.459826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-005804ca-226f-40cf-ae83-460b4fca2b49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Jul 21 22:40:36.461418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 344/696] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:36.468630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:36.477831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cce4b571-3cc0-4b99-940f-ebd7476a0e1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.176071 Jul 21 22:40:36.478651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 353/697] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:36.718904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:36.719738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:36.726851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.727298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.728052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:36.728492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:36.758091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8a0ec4b6-eea2-4412-9603-ab3a1f07fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043431 Jul 21 22:40:36.758664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 345/698] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:37.471486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:37.472947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:37.479525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.479979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.480784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.481226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.494793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:37.495403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:37.501765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.502292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.503224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.503742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.513442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5a895d3b-6d06-4d31-bdb3-84abda7b23c7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Jul 21 22:40:37.514173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 354/699] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:37.726774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:37.735079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0dceef36-fa24-4c72-9d6e-7d5109bccec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.244090 Jul 21 22:40:37.735670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 346/700] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:37.769960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:37.770798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:37.776842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.777294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.778488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:37.778626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:37.811215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c75a17d-29b9-44d0-ac24-23fea408fef0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045972 Jul 21 22:40:37.812302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 355/701] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:38.525398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:38.526328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:38.532408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.532888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.533648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.534085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.565383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-56a7f749-6920-43b7-950d-3e25bd17540d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Jul 21 22:40:38.567096 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 347/702] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:38.751862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:38.752381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:38.759485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.759936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.760734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.761189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.823085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:38.824015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:38.830524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.830982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.833181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:38.833630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:38.869396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e72df1c0-c7d7-42bf-81bf-90ac3ab95119 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050244 Jul 21 22:40:38.870166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 348/703] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:38.904101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:38.912919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-36109103-e46b-464c-a756-16532cffeb50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.164535 Jul 21 22:40:38.912919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 356/704] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:39.578392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:39.579326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:39.585905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.586421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:39.587187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.587682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:39.604153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:39.621936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1d682e96-6724-4953-ae8f-9f52faa86aef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047585 Jul 21 22:40:39.622505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 349/705] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:39.882050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:39.882902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:39.889498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.889950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:39.890713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.891150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:39.921194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-285f9d86-3275-4371-9abc-a18ba9b20d55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043288 Jul 21 22:40:39.921793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 357/706] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:39.929476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:39.930119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:39.936739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.937187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:39.937944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:39.938377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:40.074483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:40.081887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-115e5b2f-abd8-4c9d-8a6f-4ea20ffca990 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156986 Jul 21 22:40:40.082451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 350/707] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:40.634728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:40.635660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:40.641688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:40.642132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:40.642894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:40.643320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:40.675237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-949e32f0-728d-452a-84ad-ab26bb5287a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Jul 21 22:40:40.675793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 358/708] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:40.933696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:40.934675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:40.941154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:40.941604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:40.942365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:40.942799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:40.971239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d5cd6aa6-27f5-4302-bcca-fc5c50fa6e0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041589 Jul 21 22:40:40.971789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 351/709] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:41.100056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:41.100740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:41.107640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.108087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.108937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.109355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.244796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:41.252715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8cc0f3ee-a632-416f-95d9-40ca58c83614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156614 Jul 21 22:40:41.253288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 359/710] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:41.688147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:41.689019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:41.695081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.695525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.696291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.696783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.729680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3ffe1b18-3d10-4eab-a60d-0298ef60d86f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Jul 21 22:40:41.730272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 352/711] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:41.982578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:41.983411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:41.989416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.989851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.990603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:41.991052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:41.993357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:42.021840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-702240cc-1162-4575-99f7-52596352e6f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043414 Jul 21 22:40:42.022994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 360/712] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:42.269576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:42.270097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:42.276736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:42.277212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:42.278041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:42.278529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:42.520401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:42.533414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d87621a6-6bf5-4f8e-bd2c-64b595f79342 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.266747 Jul 21 22:40:42.535830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-6ceca918-4c30-4f18-93d7-b069ab7d9f11 req-7e1cee00-7bdc-4025-b2bd-86583b7b2a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "name": "network-vif-unplugged", "status": "completed", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:40:42.543012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 353/713] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:42.547352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6ceca918-4c30-4f18-93d7-b069ab7d9f11 req-7e1cee00-7bdc-4025-b2bd-86583b7b2a25 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:42.548129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6ceca918-4c30-4f18-93d7-b069ab7d9f11 req-7e1cee00-7bdc-4025-b2bd-86583b7b2a25 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:42.560951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-6ceca918-4c30-4f18-93d7-b069ab7d9f11 req-7e1cee00-7bdc-4025-b2bd-86583b7b2a25 service nova] Creating event network-vif-unplugged:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:40:42.567042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-6ceca918-4c30-4f18-93d7-b069ab7d9f11 req-7e1cee00-7bdc-4025-b2bd-86583b7b2a25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097987 Jul 21 22:40:42.567991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 361/714] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:42.740803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:42.741744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:42.748693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:42.749150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:42.749928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:42.750368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:42.780819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a0029c44-1baf-4659-a8ca-66cac2412f2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Jul 21 22:40:42.781312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 354/715] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:43.035472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:43.036498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:43.042862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.043307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.044064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.044514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.073458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0fccf321-833e-4b86-a7cb-42d161a19e73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042796 Jul 21 22:40:43.074015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 362/716] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:43.550649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:43.551255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:43.558617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.559067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.559874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.560309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.697064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:43.704695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3a5adfa9-7229-4fd3-8714-eaf9fa48d111 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157895 Jul 21 22:40:43.705258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 355/717] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:43.793890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:43.795179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:43.801508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.801956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.802721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:43.803156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:43.831363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-71f31afb-df4e-490a-b6ef-77b7dc7f81d0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Jul 21 22:40:43.831879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 363/718] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:44.085272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:44.086199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:44.092784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.093235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.094001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.094436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.124179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c837e6a9-fe20-4d80-9d51-5246057842b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042914 Jul 21 22:40:44.124779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 356/719] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:44.722999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:44.723522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:44.731879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.732388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.733868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.734308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.847711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:44.849274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:44.862385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.863197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.864552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:44.866100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:44.904840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:44.922404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0ddde326-53fd-4b86-bb6c-1428f99b0f75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.199150 Jul 21 22:40:44.922404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 364/720] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:44.922963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aa71bf5b-4950-4be8-94bc-72c94010f247 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080513 Jul 21 22:40:44.922963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 357/721] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:45.136694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:45.137623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:45.144359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.144838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.145606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.146141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.197485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8cb72207-9e8c-4407-b6d4-cb1e10bdee3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065442 Jul 21 22:40:45.198146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 365/722] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:45.935517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:45.936574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:45.940687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:45.941660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:45.944142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.944855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.946258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.947117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.950242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.950854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.951876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:45.952420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:45.998684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1792c2a7-3658-46b6-946b-e92c18ca8601 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067627 Jul 21 22:40:45.999767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 358/723] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:46.104329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:46.114720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ea36c400-407f-4624-aa9b-b7893edd78e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179366 Jul 21 22:40:46.115315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 366/724] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:46.211679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:46.212890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:46.219894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:46.220915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:46.222400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:46.223344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:46.267459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-55b9944b-da3d-4e86-b255-410863ae2ad1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059734 Jul 21 22:40:46.268212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 359/725] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:47.016418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:47.017414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:47.026245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.026803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.027796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.028416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.064943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6e5bca0-843c-41f0-a017-3242c48df798 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053139 Jul 21 22:40:47.065865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 367/726] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:47.135195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:47.135786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:47.142569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.143015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.143800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.144226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.280985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:47.281840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:47.288415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.288911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.289755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:47.290192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:47.320583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:47.325789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2951c5b7-a7cd-4de6-a5c5-74aad7d34b3c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048945 Jul 21 22:40:47.326581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 368/727] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:40:47.337382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f4ae3252-e2f8-43da-9dad-b7f6f2c469f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.206695 Jul 21 22:40:47.338080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 360/728] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:47.757909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:40:47.758842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:40:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:40:48.078250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:48.079190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:48.087966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.088429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.089288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.089726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.122556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4e8d2e73-850b-419d-99f2-42f3c242333e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048269 Jul 21 22:40:48.123390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 369/729] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:48.339166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:48.340037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:48.346998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.347451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.348217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.348709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.361260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:48.362082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:48.368925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.369381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.370215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:48.370647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:48.390801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8b5afb15-335e-4688-8195-593040805228 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056367 Jul 21 22:40:48.391615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 361/730] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:48.525450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:48.533116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e89fdd8c-d5d1-4c34-baab-fea7ee5fd462 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.181659 Jul 21 22:40:48.533687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 370/731] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:49.137927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:49.139024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:49.145936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.146438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.147228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.147690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.192849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a921bac0-1927-4797-8645-14e6041815b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060099 Jul 21 22:40:49.193786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 362/732] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:49.404375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:49.405280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:49.412867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.413411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.414857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.415436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.449876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2d368894-bf8f-4561-927f-566da3ba68c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050050 Jul 21 22:40:49.450460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 371/733] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:49.551658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:49.552567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:49.559367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.559870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.560770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:49.561243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:49.731659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:49.739620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c00fbd9e-5180-4a06-8167-8e9b7f7d3ad9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.192668 Jul 21 22:40:49.740188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 363/734] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:50.206854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:50.207779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:50.214673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.215118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.215890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.216325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.264023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-24d5d59b-ea3e-42e8-9665-96560dcee374 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061249 Jul 21 22:40:50.265075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 372/735] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:50.465398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:50.466500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:50.474235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.474782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.475732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.476279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.518201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8e08de4f-1156-4d2c-8123-77af0849e32f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059355 Jul 21 22:40:50.518995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 364/736] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:50.758359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:50.758931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:50.765817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.766266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.767060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:50.767507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:50.959894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:50.969363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-807fb2a8-ee71-42e2-9292-3acb9f3efd9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.215081 Jul 21 22:40:50.969944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 373/737] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:51.279385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:51.280317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:51.287836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:51.288197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:51.289101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:51.289570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:51.341958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb759ce8-743b-4102-ad11-30ff1e889ec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067074 Jul 21 22:40:51.343172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 365/738] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:51.531967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:51.532837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:51.539057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:51.539530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:51.540274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:51.540766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:51.574452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-48087522-a37a-49d7-b323-c6c82511df27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 Jul 21 22:40:51.575110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 374/739] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:51.988731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:51.989461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:51.998580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:51.999027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:51.999795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:52.000224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:52.003005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:52.154248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:52.162444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9b187dd7-1a10-4eef-b28f-4a1d6cb488e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179155 Jul 21 22:40:52.163025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 366/740] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:52.356566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:52.357524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:52.364388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:52.364873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:52.365660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:52.366097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:52.404017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b0929bc6-b71d-4d04-be7b-3074a626e0fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053025 Jul 21 22:40:52.404630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:52.587359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:52.588960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:52.596743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:52.597397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:52.598570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:52.599175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:52.639224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-073b52d6-f3aa-4600-8bb8-26398f1f1f45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057142 Jul 21 22:40:52.639822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 367/742] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:53.179983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:53.180697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:53.188100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.188625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.189491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.189970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.346023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:53.355416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5e2192be-02ab-44cd-91ee-e72e5c86fc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179278 Jul 21 22:40:53.356010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 376/743] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:53.418814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:53.419788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:53.427334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.427825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.428658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.429107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.494894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86527077-c158-411f-85bb-8a2eac3be188 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080396 Jul 21 22:40:53.497135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 368/744] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:53.654105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:53.655051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:53.662427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.662884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.663720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:53.664159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:53.679599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:53.699849 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3c1acdc4-a038-4eef-ac73-32feec4458b8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049577 Jul 21 22:40:53.700351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 377/745] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:54.375108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:54.375868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:54.382344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.382794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.383580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.384018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.509374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:54.510363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:54.516870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.517228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.518011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.518507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.541501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:54.551339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-49cb59ce-493d-4c81-93f7-fe1988b2adc2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.181710 Jul 21 22:40:54.552227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 369/746] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:54.563245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a44d5ea9-613a-4411-89a3-b3557a969596 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058094 Jul 21 22:40:54.564850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 378/747] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:54.711550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:54.713258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:54.720686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.721268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.722279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:54.722808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:54.756240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f449607f-6c25-44c6-9849-0bc4b8e6a6f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048632 Jul 21 22:40:54.756854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 370/748] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:55.572265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:55.573175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:55.575320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:55.576294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:55.584646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.585446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.585942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.587052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.587180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.587815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.588614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.589369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.638454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-35812ccc-7502-431a-a2b4-a45cab81f2c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067796 Jul 21 22:40:55.639043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 371/749] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:55.766041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:55.773627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:55.775782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:55.779090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c0128faa-56ca-46f7-af65-6efa1837d0f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.211126 Jul 21 22:40:55.779992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 379/750] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:55.783152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.783648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.784462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:55.784973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:55.817887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6db5696a-a852-4d7c-bb51-19a2e378f431 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051955 Jul 21 22:40:55.818478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 372/751] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:56.652961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:56.653915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:56.660782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.661259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.662049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.662485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.694417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b140b016-bb18-48ce-a833-f314757c8e75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Jul 21 22:40:56.694913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 380/752] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:40:56.804902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:56.805744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:56.813444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.813900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.814687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.815126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.831609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:56.833289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:56.838379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:40:56.845387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.846137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.847410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:56.848222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:56.887797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9634aaec-bbde-44a0-ba5b-c99fe8e37a7c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061749 Jul 21 22:40:56.888389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 381/753] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:57.017825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:57.028274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a402943f-49f6-4a0d-980f-7b05b6e28d41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.227044 Jul 21 22:40:57.028992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 373/754] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:57.709423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:57.710408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:57.718881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:57.719328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:57.720098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:57.720583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:57.750985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12ded7a1-8b1f-43f9-938c-7d5c9d7b684e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Jul 21 22:40:57.751566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 382/755] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:57.900336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:57.901436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:57.909146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:57.909605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:57.910388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:57.910832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:57.943560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2a827d0-9010-43d6-adfa-e9fcd55ae761 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047896 Jul 21 22:40:57.944164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 374/756] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:58.057703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:58.058801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:58.068800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.069544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:58.070836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.071622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:58.246258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:58.255143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4d95df41-3bcc-4efb-979e-579323623e02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.204718 Jul 21 22:40:58.255724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 383/757] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:40:58.764322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:58.765313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:58.772300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.772776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:58.773674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.774115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:58.808998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-917bc369-980e-49da-85bd-1d36ce7a415e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048890 Jul 21 22:40:58.809605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 375/758] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:40:58.957485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:58.958697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:58.967069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.967526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:58.968315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:58.968810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:59.004247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-954d93c0-6bd7-43a3-8044-5d0a9ac1868c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051065 Jul 21 22:40:59.004940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 384/759] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:40:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:40:59.284553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:59.285398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:59.294389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:59.294939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:59.296093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:59.296739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:59.469155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:40:59.477218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d8cdc68-3699-411c-99d0-4f81180d4231 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.198303 Jul 21 22:40:59.477818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 376/760] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:40:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:40:59.820924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:40:59.821871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:40:59.828859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:59.829393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:59.830168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:40:59.830609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:40:59.859881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aa3158cb-5321-47e9-b948-e7c772f3da18 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 Jul 21 22:40:59.860428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 385/761] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:40:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:00.017859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:00.018787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:00.025033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.025492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.026946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.028042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.059880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-009dfef1-c285-46a6-898a-f8eff7c435cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045970 Jul 21 22:41:00.060451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 377/762] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:00.503266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:00.503901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:00.511544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.511993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.512832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.513263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.664656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:00.674225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c78f7c1a-6b31-4a93-88ac-65bbd7f635e5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.183416 Jul 21 22:41:00.674807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 386/763] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:00.872495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:00.873711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:00.876046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=86 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:00.881395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.881842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.882608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:00.883041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:00.912965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8058a807-5910-44f8-95ab-618e8449ddf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Jul 21 22:41:00.913514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 378/764] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:01.072118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:01.073073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:01.079239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.079685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.080460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.080924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.111123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3823e71a-050d-47ab-99b3-af8421668744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042994 Jul 21 22:41:01.111577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 387/765] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:01.692913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:01.693446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:01.700327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.700807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.701618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.702182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.845835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:01.853718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f900fcd5-993e-4150-8ca2-21dd9c823c08 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.164909 Jul 21 22:41:01.854301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 379/766] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:01.925747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:01.926696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:01.933955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.934428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.935297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:01.935741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:01.968146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f126ae70-ebeb-4a50-ba0b-c45451118954 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046362 Jul 21 22:41:01.968659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 388/767] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:02.123261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:02.124984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:02.132146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.132633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:02.133422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.133857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:02.165397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d255f360-7ab2-4a78-a6be-1ca8fad2265e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046419 Jul 21 22:41:02.165986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 380/768] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:02.872417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:02.873316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:02.880357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.880836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:02.881629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.882067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:02.979230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:02.981550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:02.989390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.989896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:02.990900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:02.991553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:03.036449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:03.037003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-22e4e556-f7d0-4005-87ea-47340db245b1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061508 Jul 21 22:41:03.037967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 381/769] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:03.044852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-00500bec-f7c4-4e1c-aaee-0c896035534d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.177134 Jul 21 22:41:03.045434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 389/770] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:03.178322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:03.179180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:03.187223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:03.187668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:03.188445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:03.188926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:03.216700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:03.224092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7c7019d5-d5a5-48ff-aa94-8a284caf3a0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049802 Jul 21 22:41:03.224737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 382/771] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:04.049442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:04.050405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:04.057252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.057713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.058500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.058933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.063232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:04.063864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:04.071027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.071475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.072261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.072729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.098080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-21e4e5eb-a81a-49e6-aa81-b46296fbc3a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052296 Jul 21 22:41:04.098956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 390/772] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:04.224294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:04.233933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bfff9bf9-eab1-4513-8c13-9259d2495326 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.175041 Jul 21 22:41:04.234526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 383/773] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:04.236758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:04.237809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:04.244751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.245233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.246678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:04.247122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:04.281223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d759638-b2fa-4b81-8aac-4b7e49cda91b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048575 Jul 21 22:41:04.281895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 391/774] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:05.111212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:05.112166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:05.119129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.119588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.120755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.121200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.154756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d65272cd-73fb-4061-9abe-07a5f7aeec3d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047840 Jul 21 22:41:05.155357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 384/775] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:05.252382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:05.253023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:05.259854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.260292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.261644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.262073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.294644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:05.295460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:05.302438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.302884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.303660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:05.304094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:05.337812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6e6a0143-e424-45bc-9788-b7ca51a7cdba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048408 Jul 21 22:41:05.338451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 385/776] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:05.445492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:05.454119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-162f808c-55a3-4e72-a008-95cf2616624f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.205482 Jul 21 22:41:05.454701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 392/777] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:06.166404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:06.167413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:06.174140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.174624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.175412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.175847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.209142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c6922448-78db-43c6-b4cb-0ae17eb21f7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 Jul 21 22:41:06.209724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 386/778] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:06.351100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:06.352058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:06.359938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.360383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.361192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.361627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.395771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-181abdfb-3558-4dec-8acd-52877af081e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048750 Jul 21 22:41:06.396326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 393/779] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:06.471278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:06.471951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:06.478724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.479165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.479989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:06.480422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:06.637480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:06.647522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c931bbc2-5847-46de-a786-08771f10f047 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179930 Jul 21 22:41:06.648341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 387/780] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:07.221482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:07.222327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:07.228992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.230079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.230858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.231291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.233956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:07.263703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d244a34-bd15-4014-8627-d37712e0be83 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Jul 21 22:41:07.264289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 394/781] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:07.407842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:07.408798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:07.415205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.415651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.416430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.416969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.451001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ae67b6f7-ceaf-411a-8750-8b2a6319e864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Jul 21 22:41:07.451592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 388/782] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:07.665715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:07.666319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:07.673282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.673726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.674490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:07.674916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:07.829712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:07.838109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-828e7058-60af-4b53-b4df-4f3e46bddb89 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.176116 Jul 21 22:41:07.839616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 395/783] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:08.275564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:08.276738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:08.283912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.284370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.285205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.285640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.319722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f2db9b2f-71ac-491c-98c8-4168d68cdf35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048202 Jul 21 22:41:08.320397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 389/784] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:08.462555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:08.463487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:08.470415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.470864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.471650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.472088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.504140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-351a76e8-d179-48c3-a109-860c901a735e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045468 Jul 21 22:41:08.504774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 396/785] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:08.863826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:08.864435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:08.871550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.872005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:08.873072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:08.873520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.013155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:09.021143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d5901265-80f5-4955-92a0-042e63ec458d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161192 Jul 21 22:41:09.021715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 390/786] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:09.335130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:09.336106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:09.343741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.344197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.345041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.345481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.378906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e295729c-6c68-4a2f-a62a-4ad837062f7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048082 Jul 21 22:41:09.379545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 397/787] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:09.517268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:09.518218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:09.525273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.525726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.527009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:09.527455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:09.561215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6ab7692e-94bb-4604-b37d-c9fbc69e5e44 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048352 Jul 21 22:41:09.561806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 391/788] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:10.041007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:10.042748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:10.053385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.054181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.055570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.056382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.221720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:10.232648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-59427b6a-5d1f-401d-af80-566419bc4d52 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.197667 Jul 21 22:41:10.233226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 398/789] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:10.391806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:10.392733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:10.398951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.399403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.400182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.400657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.458669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6640274a-a633-429c-b3f6-6b203529eacf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070540 Jul 21 22:41:10.459705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 392/790] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:10.573919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:10.574868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:10.581877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.582326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.583106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:10.583540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:10.616763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-66c62796-8f19-41f6-8fb0-3b89328bb21e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047246 Jul 21 22:41:10.617567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 399/791] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:11.258064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:11.258827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:11.266028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.266475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.267242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.267674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.418382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:11.427404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15724fd9-1112-47c8-838a-c371419ebe72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.173057 Jul 21 22:41:11.428188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 393/792] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:11.471312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:11.472203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:11.478922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.480206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.481055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.481488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.515141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52b1c006-bd1a-42bd-b980-e03a460e8b09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048021 Jul 21 22:41:11.515717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 400/793] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:11.630348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:11.631303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:11.638406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.638853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.639634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:11.640061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:11.672934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be842b3d-4ae0-46b5-9f66-557565cc7dee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046498 Jul 21 22:41:11.673533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 394/794] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:12.447215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:12.448650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:12.455340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.455823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.456632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.457070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.527039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:12.528020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:12.535049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.536060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.536285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.536766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.570084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ad0f1fe3-677e-4b8c-af06-d8c024094077 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Jul 21 22:41:12.570691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 395/795] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:12.608895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:12.616775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ec8e4709-3710-4e03-9fa1-809b237a6d13 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.173407 Jul 21 22:41:12.617356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 401/796] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:12.685136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:12.685972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:12.692101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.692585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.693336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:12.693770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:12.724513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9ac84993-f38a-4e6a-9564-a6e5adbda3c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043538 Jul 21 22:41:12.725079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 396/797] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:13.582453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:13.583293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:13.591101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.591552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.592338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.592781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.623690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-97d7ddf4-ecb0-48f6-b5b9-743370a52f53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Jul 21 22:41:13.624281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 402/798] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:13.636105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:13.637344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:13.643508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.643988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.644806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.646970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.735626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:13.736580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:13.742786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.743226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.743993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:13.744416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:13.777816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-36e33f4a-49cb-4798-bcc7-f9260cfe333f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Jul 21 22:41:13.778603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 403/799] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:13.786949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:13.800671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-677a90e9-c7f0-447b-be18-c400e6a21e20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.169286 Jul 21 22:41:13.801261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 397/800] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:14.635421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:14.636508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:14.643403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.643848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.644658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.645095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.676064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3b0dae06-86ef-4cb1-af05-91711e5a9941 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Jul 21 22:41:14.676654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 404/801] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:14.789650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:14.790577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:14.799907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.800361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.801169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.801611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.818244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:14.818847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:14.825869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.826314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.827089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:14.827520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:14.833594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-41e47ed8-dd3e-41c4-835e-64dc50d2e584 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047876 Jul 21 22:41:14.834177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 398/802] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:14.972974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:14.984988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-580c26fe-b626-46a2-8077-f280bab57806 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.170452 Jul 21 22:41:14.985575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 405/803] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:15.688305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:15.689169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:15.695364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.695802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.696597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.697027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.711829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:15.729246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-adcee5e3-2f74-4e98-bfa6-735e2d11ea62 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Jul 21 22:41:15.729821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 399/804] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:15.846469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:15.847419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:15.853460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:41:15.853847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:41:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments (ip 10.222.0.42) !!! Jul 21 22:41:15.855099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.856050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.856937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:15.857591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:15.890080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-323b3d11-c053-46c2-b345-a2bd6039cf86 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047630 Jul 21 22:41:15.890652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 406/805] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:16.002772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:16.003327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:16.011303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.011757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.012579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.013020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.159381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:16.168438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b0f47432-a16d-4fb7-a941-ca1e5992e7f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.169585 Jul 21 22:41:16.169135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 400/806] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:16.741125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:16.741960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:16.749403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.749841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.750608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.751038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.783823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-09d69801-2ff6-4bc3-9a32-02c867d4febc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046667 Jul 21 22:41:16.784378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 407/807] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:16.902304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:16.903238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:16.909755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.910205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.910991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:16.911423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:16.945944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a20fbbb9-01cc-4678-b9eb-30482be948b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047837 Jul 21 22:41:16.946521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 401/808] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:17.186311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:17.186905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:17.193243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.193682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.194521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.194866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.327289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:17.335056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-11666581-948c-4458-ac8f-eaf9091d719f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153184 Jul 21 22:41:17.335630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 408/809] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:17.796122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:17.797076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:17.803576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.804024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.804824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.805256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.834785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1cb80453-1a79-46cc-9a74-26ef73026425 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043168 Jul 21 22:41:17.835336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 402/810] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:17.958851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:17.959762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:17.966118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.966561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:17.967324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:17.967753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.003889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-47a67aba-ec87-445e-99d8-8c9d64852308 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048642 Jul 21 22:41:18.004975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 409/811] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:18.352831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:18.353444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:18.360146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.360624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.361399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.361837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.494734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:18.504710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0ad80880-2b5b-4daf-ad40-1fda79e7a5fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155588 Jul 21 22:41:18.505299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 403/812] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:18.846620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:18.847552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:18.854575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.855023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.855797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:18.856238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:18.883260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:18.889148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-362e2d37-ee80-465b-a1da-28d984f34a4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Jul 21 22:41:18.889718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 410/813] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:19.016431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:19.017444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:19.024135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.024625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.025392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.025890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.054938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-040b8066-48f9-4788-b74f-c9c9a3eb724c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042518 Jul 21 22:41:19.055489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 404/814] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:19.522275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:19.522875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:19.529138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.529581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.530335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.530760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.669549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:19.677582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-db14f7ed-6796-4ac4-be5b-4c32afcd42a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159074 Jul 21 22:41:19.678159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 411/815] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:19.900913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:19.901844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:19.907925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.908369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.909164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:19.909594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:19.939501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-28f5d79b-a744-4cab-bb70-a3b3b79ae1d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 Jul 21 22:41:19.940054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 405/816] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:20.067786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:20.068759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:20.075806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.076247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.077045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.077477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.115177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5aea5358-43c4-4b9e-8ac4-cbaa4a5b0b0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051272 Jul 21 22:41:20.115981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 412/817] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:20.700630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:20.701151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:20.707614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.708055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.708874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.709301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.854682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:20.861454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee9764e6-d38f-4339-8198-342c3a7b4f8a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.165386 Jul 21 22:41:20.862033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 406/818] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:20.952449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:20.953347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:20.959573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.960026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.960838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:20.961279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:20.992649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46db3cf3-f545-48f0-9936-aee70d1ff9ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Jul 21 22:41:20.993225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 413/819] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:21.128612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:21.129530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:21.135654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.136100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:21.136999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.137398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:21.170140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-769aa788-a443-4347-8bf3-7a88778555db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045461 Jul 21 22:41:21.170712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 407/820] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:21.880106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:21.880730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:21.888640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.889144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:21.890012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:21.890576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:22.007812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:22.008836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:22.018133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:22.019117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:22.019679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:22.020289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:22.036718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:22.040531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5c26cd8f-6048-4480-b082-f1d119d09f66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.165018 Jul 21 22:41:22.041123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 414/821] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:22.058259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bf4b55cb-04b3-4e23-a469-44197cc49527 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056003 Jul 21 22:41:22.058887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 408/822] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:22.183060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:22.184721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:22.190963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:22.191403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:22.192173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:22.192654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:22.226346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78a0b31a-7a8b-4d07-830c-c04b4ea48d13 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047667 Jul 21 22:41:22.227383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 415/823] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:23.058762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:23.059374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:23.066211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.066591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.067366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.067805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.070603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:23.071635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:23.079844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.080293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.081137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.081596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.114348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-38c97d36-13c2-47ac-8e30-a998471490ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Jul 21 22:41:23.114939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 416/824] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:23.208114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:23.217072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89bb1ba2-cc05-463b-804e-27c06fb464dc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.162726 Jul 21 22:41:23.217658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 409/825] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:23.241620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:23.242535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:23.249576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.250017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.250786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:23.251228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:23.281653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-75eee57c-4eb9-40d5-af22-5925c2f3b2ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043901 Jul 21 22:41:23.282245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 417/826] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:24.126380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:24.127424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:24.134496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.134943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.135987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.136612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.168295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9381607f-94fd-40e2-8cbb-6487f21b8ed3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Jul 21 22:41:24.168811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 410/827] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:24.235134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:24.235740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:24.242405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.242852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.243617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.244048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.294361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:24.295406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:24.302109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.302651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.303516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:24.304035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:24.339300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f12f412-40c6-408d-bd1d-21aabd02174b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049591 Jul 21 22:41:24.340260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 411/828] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:24.406878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:24.415914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32492788-0e50-4d0f-b6d0-fd72bd846d7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.184881 Jul 21 22:41:24.416511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 418/829] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:25.180393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:25.181378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:25.188786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.189235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.190001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.190494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.221313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8fd397ea-95e4-4f14-9f08-5e3ad74c255e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044939 Jul 21 22:41:25.221948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 412/830] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:25.351705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:25.352641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:25.360134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.360606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.361525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.361953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.391616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d7f59415-784d-4721-b11c-b34f34cc78b5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044263 Jul 21 22:41:25.392168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 419/831] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:25.435204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:25.435204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:25.441313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.441752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.442515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:25.442945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:25.614541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:25.624123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ff5e86d2-f456-4b12-af32-3b9ec92ea255 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.194273 Jul 21 22:41:25.624736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 413/832] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:26.233359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:26.234295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:26.240433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.241014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.241680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.242108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.274765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2262b394-f275-4217-b49c-fc00067cc7b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Jul 21 22:41:26.275367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 420/833] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:26.403667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:26.404649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:26.411474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.411916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.412712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.413157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.446105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-74ca8e7a-e020-40b4-a042-4be07e2cb070 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046566 Jul 21 22:41:26.446704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 414/834] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:26.642056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:26.642661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:26.649565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.650043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.650825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:26.651295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:26.798044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:26.805890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e8142ea9-0dfc-4b37-95b3-8c62e6dc3de3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.168005 Jul 21 22:41:26.806492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 421/835] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:27.287434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:27.288384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:27.295523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.295971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.296783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.297216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.328509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cfc17b33-92c4-4076-b5fb-fc663a3d9411 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Jul 21 22:41:27.329080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 415/836] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:27.458671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:27.459593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:27.461543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=82 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:27.467777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.468230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.469061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.469497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.501624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a4e98fd9-0c88-4792-94b4-575f72691604 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046904 Jul 21 22:41:27.502198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 422/837] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:27.824256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:27.824931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:27.831701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.832151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.832977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:27.833467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:27.836562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:27.992975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:28.005555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e0378409-9d78-4836-9d86-8ff76a1b4e31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.185781 Jul 21 22:41:28.006149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 416/838] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:28.340406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:28.341379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:28.348847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:28.349369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:28.350150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:28.350594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:28.399582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-15fe057f-04f0-4a2d-95a3-a4ea11669d2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063756 Jul 21 22:41:28.400168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 423/839] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:28.514710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:28.515654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:28.522276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:28.522719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:28.523493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:28.523923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:28.556326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-30d83371-1496-4ee8-87c4-8b827919c844 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046147 Jul 21 22:41:28.556943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 417/840] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:29.023294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:29.023905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:29.030775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.031232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.032089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.032545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.186590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:29.194905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-34c48a2b-7526-42a1-877b-fb50bfb8a4ee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.175378 Jul 21 22:41:29.195492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 424/841] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:29.410894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:29.411742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:29.420122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.420608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.421415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.421856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.459493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a58d6988-f9fb-4f8a-bad5-e1fccd60a785 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052611 Jul 21 22:41:29.460155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 418/842] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:29.568381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:29.569548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:29.576865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.577326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.578129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:29.578566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:29.614719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5ec7c4a3-c5e4-4647-972a-ecd7877e3074 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050409 Jul 21 22:41:29.615302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 425/843] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:30.213020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:30.213705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:30.220169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.220676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.221488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.221930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.378960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:30.389794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-47839080-d67a-45a5-9d39-99f64b89f104 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.180994 Jul 21 22:41:30.390393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 419/844] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:30.475070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:30.476212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:30.483051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.483492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.484267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.484729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.516945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1438a99e-b9ab-4985-be38-f8b5529c9ab0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046410 Jul 21 22:41:30.517538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 426/845] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:30.627855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:30.629032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:30.639342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.639977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.641177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:30.641854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:30.677543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-348f1249-1b45-4e63-a722-76569f44d716 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053625 Jul 21 22:41:30.678153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 420/846] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:31.407711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:31.408310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:31.415152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.415602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.416387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.417578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.434679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.530155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:31.531108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:31.533085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=86 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.539074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.539525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.540319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.540801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.568017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:31.576887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3033f076-5548-4444-b2b8-c50496f8ba39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051621 Jul 21 22:41:31.577477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 421/847] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:31.582323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-999749b2-df1d-4702-a25b-1f962fd20107 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.178149 Jul 21 22:41:31.583366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 427/848] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:31.689924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:31.690749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:31.697303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.697866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.698786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.699217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.732208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-29ed3c1c-58af-41d6-a407-f89f46f495bc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046285 Jul 21 22:41:31.732821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 422/849] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:32.590755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:32.592133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:32.599302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.599663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:32.599850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.600176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:32.600613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.601069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.607195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.607635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.608409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.608870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.634180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8918a84-6665-4560-8695-38768135c77f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050213 Jul 21 22:41:32.634772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 428/850] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:32.744420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:32.746093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:32.752640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.753086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.753875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.754279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.763198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:32.771257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b6ab0f9c-3a30-4c6e-be60-ecdaab50c83c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.175781 Jul 21 22:41:32.771840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 423/851] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:32.786539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a91d0553-7cc3-48ca-ab24-bc56c77f825c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046193 Jul 21 22:41:32.787116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 429/852] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:33.647298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:33.648235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:33.655908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.656386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.657266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.657722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.693436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-362b25e8-25e3-46a5-8d72-e0621a6f3f4b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Jul 21 22:41:33.694036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 424/853] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:33.788981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:33.789592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:33.797608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.798059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.798846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.799247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:33.799987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.800195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:33.807920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.808403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.809230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.809681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.847721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b25626dc-fb07-4a68-b92f-fe1f98c5882c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052986 Jul 21 22:41:33.848334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 425/854] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:33.958793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:33.968346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-09961dea-a980-45f7-9115-796cff0cccf9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.183557 Jul 21 22:41:33.969298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 430/855] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:34.711480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:34.713063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:34.724001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.724759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.726139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.726935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.786418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7552c299-c45f-4c20-8513-8ee9da8cc6db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082382 Jul 21 22:41:34.787486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 426/856] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:34.860282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:34.861255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:34.868300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.868783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.870172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.870609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.904263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-141bb907-b729-456e-b04f-4d7f9842ddcb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048093 Jul 21 22:41:34.904890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 431/857] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:34.996378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:34.997359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:35.005058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.005505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.006300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.006739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.189956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:35.199392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-246be8d4-50c1-48dc-b874-2247fb7a771d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.216594 Jul 21 22:41:35.199990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 427/858] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:35.799185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:35.800129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:35.806617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.807227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.808072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.808530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.842454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a373a8cc-7057-43c6-9e56-246770ca08fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Jul 21 22:41:35.843049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 432/859] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:35.919965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:35.920975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:35.927464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.927912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.928742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.929182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.963154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1844289a-02ee-4526-8cb6-25c440ce0bea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048116 Jul 21 22:41:35.967488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 428/860] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:36.217237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:36.217798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:36.225383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.225833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.226635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.227076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.400039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:36.408756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6e90b9b8-a361-47c3-9561-4f1566a7f6df tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.195355 Jul 21 22:41:36.409495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 433/861] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:36.855396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:36.856357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:36.863553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.864007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.864832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.865269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.900460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89734fb9-3dce-4145-b898-4d4ff3a20c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049817 Jul 21 22:41:36.901580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 429/862] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:36.981586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:36.983099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:36.994001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.995448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:36.996965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:36.997520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:37.033244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a369adc3-a8af-46e0-88a9-0e399b08ce64 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059570 Jul 21 22:41:37.033867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 434/863] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:37.427343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:37.427981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:37.435795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:37.436242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:37.437048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:37.437484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:37.575561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:37.583468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d21d2dde-d0bc-435c-8ad4-50af5385b221 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160172 Jul 21 22:41:37.584046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 430/864] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:37.913394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:37.914242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:37.921209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:37.921655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:37.922544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:37.922982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:37.955713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0b7aa058-985f-4101-a733-8bcb7587c73f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046544 Jul 21 22:41:37.956291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 435/865] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:38.047263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:38.048293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:38.055502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.055948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.056821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.057829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.090181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8054949c-fcfd-4d50-a2cc-17e3c89cc694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048673 Jul 21 22:41:38.090773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 431/866] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:38.601226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:38.601830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:38.609256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.610365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.611144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.611575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.748667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:38.756728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5dc151ba-a71c-4bf1-9769-9b125aa6356e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159218 Jul 21 22:41:38.757340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 436/867] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:38.968214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:38.969175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:38.975415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.975864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.976682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.977124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.004718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:39.009394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-27e1a322-5fc6-4be0-855b-e42c6f27ca21 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Jul 21 22:41:39.010187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 432/868] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:39.102241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:39.103075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:39.110336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.110780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.111554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.111984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.144944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3a40872e-3cf6-4845-bb8b-afa1b760a6b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046653 Jul 21 22:41:39.145522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 437/869] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:39.775099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:39.776272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:39.783209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.783655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.784495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.784942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.933525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:39.941364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-31022b96-3fbe-4202-aea4-e2847a046269 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.170519 Jul 21 22:41:39.941958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 433/870] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:40.021475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:40.022407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:40.030140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.030495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.031290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.031724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.064106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afbc79d2-2d34-4edf-a954-c091a43c5e66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Jul 21 22:41:40.064740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 438/871] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:40.157564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:40.158643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:40.164895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.165355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.166226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.167155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.200813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5b2b80a0-c1a4-49b3-ab77-5db10272c462 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047118 Jul 21 22:41:40.201409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 434/872] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:40.959222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:40.959843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:40.966616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.967061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.967866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.968301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.080359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:41.081638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:41.088382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.088870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.089644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.090391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.111247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:41.118916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-818eedd2-13fe-48ec-8543-8fa3c46c28ea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.163620 Jul 21 22:41:41.119487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:41.120218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b5d7398b-5462-4567-924e-d8012b4a25ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044559 Jul 21 22:41:41.120896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 435/874] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:41.213085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:41.214006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:41.220083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.220553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.221321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.221757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.254154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3c493ef0-1d92-4c30-9355-087866935c9d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045045 Jul 21 22:41:41.254740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 440/875] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:42.133889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:42.134840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:42.140127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:42.140949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:42.141993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.142443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.143221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.143650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.151407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.152705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.154255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.155031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.175877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-73ec36d0-1bc5-4e28-881d-2ca5e6f8345e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046456 Jul 21 22:41:42.176452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 436/876] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:42.265792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:42.266741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:42.272915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.273450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.274345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:42.274843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.291168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:42.299186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c8dbe4f-36ae-4581-99f9-bfe7507fb02a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.165075 Jul 21 22:41:42.299763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 441/877] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:42.307254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e69a88ff-1acb-4759-92a4-191a325281ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045529 Jul 21 22:41:42.307835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 437/878] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:43.187926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:43.188790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:43.195640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.196108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.196924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.197358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.230180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-decb4323-8ea3-45a1-950e-72f25e4afbcf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046206 Jul 21 22:41:43.230764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 442/879] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:43.322196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:43.322560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:43.323322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:43.324251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:43.331906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.332500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.333315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.333490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.333798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.334113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.335141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.335709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.375546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab47f04d-a0b6-44dc-9ff3-295e6f025ae7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059219 Jul 21 22:41:43.379515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 443/880] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:43.566087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:43.574371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-02b8afc5-aecc-459d-b555-923878300578 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.258836 Jul 21 22:41:43.575650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 438/881] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:44.242030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:44.242908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:44.250812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.251266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.252035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.252466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.254968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:44.283530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecd27f50-d899-4c65-b56e-c5a315537605 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045492 Jul 21 22:41:44.284109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 444/882] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:44.388132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:44.389089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:44.395875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.396321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.397168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.397600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.428793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1ba58fa4-00ad-4ad7-be02-2c836b132952 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045222 Jul 21 22:41:44.429365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 439/883] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:44.592362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:44.593055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:44.600315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.600785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.601562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.601996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.755417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:44.765091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d1d08503-1a6a-4373-bcc8-80a5a095aaab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.176672 Jul 21 22:41:44.765676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 445/884] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:45.296328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:45.297271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:45.303369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.303820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.304610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.305041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.334730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a14e7b75-fff8-401b-a6ef-e3dc570676ab tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Jul 21 22:41:45.335296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 440/885] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:45.440638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:45.441557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:45.448112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.448591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.449355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.449781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.486276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0f47fa63-4210-4b44-946b-e0e596cf41d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049560 Jul 21 22:41:45.486860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 446/886] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:45.785724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:45.786330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:45.800048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.800857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.802174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.802852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.938476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:45.945924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c07ed334-624d-4073-a4e2-011954552d35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.164072 Jul 21 22:41:45.946481 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 441/887] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:46.346810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:46.347977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:46.354663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.355832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.356702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.357163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.389341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3e69db8d-625d-4736-9f53-d030a1288460 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046705 Jul 21 22:41:46.389919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 447/888] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:46.498385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:46.499299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:46.506232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.506680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.507473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.507914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.539957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b9e0c9ba-1c74-4485-8ed9-daa97f1a2a94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046251 Jul 21 22:41:46.540562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 442/889] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:46.962784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:46.963393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:46.970833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.971291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.972066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.972527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.110961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:47.118412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f462d7af-4345-489a-9c2f-09de3be71c19 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159477 Jul 21 22:41:47.119061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 448/890] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:47.401275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:47.402242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:47.409398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:47.409853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.410636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:47.411076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.442456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-22abde1c-09d0-4934-9d8c-ba6176c2b36c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Jul 21 22:41:47.443062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 443/891] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:47.553085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:47.554128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:47.560266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:47.560744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.561657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:47.562108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.594904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12afa200-9bcb-48c3-bfbc-38e5a89d5132 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046812 Jul 21 22:41:47.595480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 449/892] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:48.136336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:48.137008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:48.143280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.143730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.144517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.144958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.278320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:48.285972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d3baee26-ca17-4cf8-a94c-745ac8e6bace tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153540 Jul 21 22:41:48.286554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 444/893] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:48.454092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:48.455003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:48.461896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.462339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.463115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.463542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.497933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8faf1491-9e8b-410a-8a7d-377f36aaf4de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047716 Jul 21 22:41:48.498523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 450/894] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:48.606820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:48.607763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:48.615077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.615521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.616284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.616749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.645685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4af7fb58-88b2-4f8f-931e-b432a37479a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042735 Jul 21 22:41:48.646168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 445/895] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:49.303413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:49.304100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:49.311458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.312423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.313220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.313655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.447276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:49.456178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4cd6b0fb-b874-4f98-80d9-437b1e4a0c21 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156754 Jul 21 22:41:49.456822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 451/896] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:49.510346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:49.511272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:49.518518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.518969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.519735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.520184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.550200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-968e1d01-68df-43b9-8c65-7f4ffc9cb87a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Jul 21 22:41:49.550749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 446/897] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:49.658383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:49.659214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:49.665699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.666146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.666906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.667338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.697808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3f619e85-fb7c-46a5-8243-308b2dbfd004 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043651 Jul 21 22:41:49.698376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 452/898] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:50.473579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:50.474244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:50.480768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.481216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.481973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.482403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.561459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:50.562721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:50.568723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.569170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.569928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.570359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.600977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8e286af0-4821-4123-8a37-931bad5a7ccc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043294 Jul 21 22:41:50.601549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 453/899] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:50.617571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:50.625958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-25bfeefd-a586-48b6-a4aa-0bd8ffb69058 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156237 Jul 21 22:41:50.626526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 447/900] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:50.709944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:50.710783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:50.717245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.717681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.718503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.719093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.747721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3dd01369-5cb2-4cdc-892a-8340c3556358 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041932 Jul 21 22:41:50.748266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 454/901] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:51.613577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:51.614415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:51.620548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.620999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.622007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.622438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.642132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:51.642860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:51.649266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.649720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.650497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.650972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.651667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e4075656-dfef-4a4a-9148-c8b501b834fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Jul 21 22:41:51.652231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 448/902] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:51.759597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:51.760535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:51.767068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.767512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.768268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.768821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.783637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:51.787207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:51.794543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9aa3d52-a0e2-4063-a3be-857fc5e64e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156295 Jul 21 22:41:51.795322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 455/903] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:51.800707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ae98782b-5648-49cb-876d-8190fbed753c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045006 Jul 21 22:41:51.801335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 449/904] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:52.663536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:52.664454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:52.670470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.671491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.672172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.672638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.702552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aa2c7615-3de4-405c-b65c-800445339230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042741 Jul 21 22:41:52.703035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 456/905] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:52.811204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:52.813384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:52.813516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:52.814328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:52.820684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.821167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.821350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.821805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.821937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.822359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.822577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.823014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.851568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1c10269d-0fba-4b20-a123-1d6ba6c74150 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043195 Jul 21 22:41:52.852130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 457/906] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:41:52.959332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:52.966754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-593d72d1-e5c2-4613-904d-3b5114c6780a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159522 Jul 21 22:41:52.967314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 450/907] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:53.714661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:53.715498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:53.721809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.722263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:53.723019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.723458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:53.753396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5cfde5fd-b23b-457b-8e17-40116942449b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Jul 21 22:41:53.753948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 458/908] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:53.863309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:53.864222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:53.870678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.871379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:53.872132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.872595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:53.902336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1c4f28ef-ee78-4672-b668-b46d2b8cc377 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043004 Jul 21 22:41:53.902882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 451/909] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:53.984875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:53.985402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:53.991856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.992306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:53.993138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:53.993598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.130490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:54.137888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4be7e370-f946-4939-a8b9-ee94f9aecbb4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157184 Jul 21 22:41:54.138443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 459/910] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:54.765492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:54.766398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:54.772424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.772902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.773659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.774092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.802570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc5ae7b9-a5e4-49be-a3e4-e49b613f0d49 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041543 Jul 21 22:41:54.803118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 452/911] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:54.914285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:54.915133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:54.921706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.922172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.922935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.923373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.947654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:54.953913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c697e79b-a182-4c64-a7fc-79ef3029195d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043632 Jul 21 22:41:54.954476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 460/912] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:55.154531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:55.155122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:55.161628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.162068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.162820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.163250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.508827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:55.516728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-820b59c8-4eb5-44be-84f0-336a3787a977 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.366007 Jul 21 22:41:55.517302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 453/913] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:55.814345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:55.815261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:55.822333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.822777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.823567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.824028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.854639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5a6b0111-865a-413f-be7d-45e21a3de7e0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Jul 21 22:41:55.855183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 461/914] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:55.965653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:55.966572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:55.973330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.973773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.974531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.974964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.004174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d355da72-e8eb-48d2-b73d-4a8120af5a45 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042469 Jul 21 22:41:56.004753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 454/915] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:56.534664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:56.535255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:56.541217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.541655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.542446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.542872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.676951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:56.684780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b7dcf76-7d80-44f8-b122-b9cca018a08a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154466 Jul 21 22:41:56.685285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 462/916] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:56.866498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:56.867429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:56.874830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.875345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.876111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.876571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.912751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-41d5fb82-fc69-47a4-a7d7-9fa1b8c7357a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050081 Jul 21 22:41:56.913327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 455/917] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:57.017486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:57.018353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:57.025542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.025991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.026794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.027508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.058777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-681c880a-3b36-49f8-82f5-23178896557e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046418 Jul 21 22:41:57.059334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 463/918] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:57.703104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:57.703368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:57.709336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.709756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.710518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.710949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.845856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:57.853785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd2b9a6f-7d13-405e-a274-883cda3c2b30 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155450 Jul 21 22:41:57.854349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 456/919] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:57.923974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:57.924951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:57.926882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:57.932543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.932997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.933836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.934183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.964853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5698c709-c808-4c4a-ac41-ca7606bc5c46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Jul 21 22:41:57.965328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 464/920] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:58.071320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:58.072280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:58.079886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.080344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.081145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.081576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.112229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c064f80b-e5e4-4db8-ac50-a0b607213df0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044869 Jul 21 22:41:58.112817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 457/921] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:41:58.870824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:58.871769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:58.880039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.880514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.881298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.881731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.977392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:58.978318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:58.985616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.986068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.986861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.987299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.021825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9aa93bf3-8dd2-41b0-83bb-fcf0ff635169 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048413 Jul 21 22:41:59.022416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 458/922] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:41:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:59.034466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:59.042846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0d74bcc7-ea62-482f-8777-1edb1dbb0747 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.175862 Jul 21 22:41:59.043411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 465/923] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:59.123818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:59.125444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:59.132468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.132953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.133735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.134179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.165492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8837ca75-da89-4e1d-be10-a67fc195191f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045949 Jul 21 22:41:59.166068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 459/924] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:41:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:00.035883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:00.036858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:00.043576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.044022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.044834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.045293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.061549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:00.062295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:00.070199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.070787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.071577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.072016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.077820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7ac504ee-e87b-4f81-9574-70583ff8ecc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Jul 21 22:42:00.078726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 466/925] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:00.177829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:00.178772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:00.185419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.185870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.186671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:00.187120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:00.221004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f98ee1d-2760-4611-bcaa-4a822723b44b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047142 Jul 21 22:42:00.221175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:00.225059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 467/926] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:00.229761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ed4fabb7-fd13-4c8a-a7be-c0f6addcd40e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.173744 Jul 21 22:42:00.230339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 460/927] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:01.089831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.090777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.098846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.099299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.100111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.100578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.141435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70237ca8-92cb-4e3c-b341-55dba4a4fb8c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055366 Jul 21 22:42:01.141927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 468/928] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:01.233348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.234898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.241726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.242177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.242957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.243384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.248960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.249637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.256924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.257539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.258336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.258775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.277565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6e82c04b-bac0-43fc-ab97-539c6e899c75 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048429 Jul 21 22:42:01.278201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 461/929] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:01.403217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:01.411507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7eb0e142-9083-4ae7-8d91-9149d9c594bf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167897 Jul 21 22:42:01.412075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 469/930] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:02.154322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.155299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.157256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=82 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.162665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.163109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.163882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.164308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.194805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2945040-17b3-4f7f-b8b2-bb44025a955b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Jul 21 22:42:02.195375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 462/931] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:02.290149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.291068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.298140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.298588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.299348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.299781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.329710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fdd5c666-b3f2-4762-a963-a3cf3702246d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043529 Jul 21 22:42:02.330288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 470/932] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:02.429692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.430228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.437522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.437994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.438765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.439197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.568634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.576060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d94868bd-0135-4952-9324-f776a17eb67c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150311 Jul 21 22:42:02.576640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 463/933] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:03.207530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:03.208373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:03.214896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.215350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.216120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.216604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.247203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4960460e-8ea9-4c80-8ec3-0a61413b0b14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Jul 21 22:42:03.247784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 471/934] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:03.341848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:03.343491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:03.349934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.350385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.351224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.351658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.386158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8acc5e77-ad82-4e26-8ae7-c1474fd49c34 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048231 Jul 21 22:42:03.386953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 464/935] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:03.593711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:03.594327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:03.601029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.601482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.602259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:03.602703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:03.742639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:03.750982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8b26db7-ccab-4021-8fa0-9536a487b93e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161588 Jul 21 22:42:03.751579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 472/936] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:04.259667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:04.260523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.267224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.267675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.268439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.268902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.301567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cbd283f7-468c-4e39-b743-bf9231ced919 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Jul 21 22:42:04.302139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 465/937] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:04.399665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:04.400652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.408028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.408468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.409319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.409733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.445577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37758b82-a6c7-4ab2-a78f-7fe2299639e0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049897 Jul 21 22:42:04.446236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 473/938] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:04.769052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:04.769660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.775655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.776104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.776891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.777331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.782448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:04.909548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:04.917066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3ca338d-060b-47c6-98ad-2f96fdc268c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152951 Jul 21 22:42:04.917631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 466/939] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:05.313856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:05.314923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:05.321463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.321916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.322681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.323129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.353709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c0022326-1dd4-45c6-b879-5f50fff0fa57 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044524 Jul 21 22:42:05.354270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 474/940] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:05.458736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:05.459743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:05.466505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.466965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.468406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.468903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.500872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e84287ba-00de-4495-9800-e058afcb3ebc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046010 Jul 21 22:42:05.501448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 467/941] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:05.934519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:05.935157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:05.942279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.942727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:05.943486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:05.943921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.073486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:06.081211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f93a5827-7186-4bd0-b769-0e84cf08699f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150555 Jul 21 22:42:06.081764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 475/942] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:06.365541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:06.366510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:06.372926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.373377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.374784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.375241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.403996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-996ea32f-ff49-4edb-afc3-d2c2e398def1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042421 Jul 21 22:42:06.404580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 468/943] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:06.512682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:06.514713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:06.520243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.520724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.521500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:06.521951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:06.552826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7257012c-e628-4dd5-8f8e-0b63e5fbe6e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044147 Jul 21 22:42:06.553391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 476/944] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:07.098850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:07.099447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:07.106000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.106443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.107197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.107625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.246814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:07.254925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3ecacb4a-4603-491c-98d8-736da3360648 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159919 Jul 21 22:42:07.255480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 469/945] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:07.415755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:07.416713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:07.422920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.423366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.424134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.424602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.438938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:07.455491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63839981-f7ec-4927-949a-15bdd4a0b0b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043586 Jul 21 22:42:07.455974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 477/946] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:07.564390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:07.565361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:07.571419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.571866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.572663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:07.573107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:07.600952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-49c0223b-09e8-46ef-8662-2ca4552d9040 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041159 Jul 21 22:42:07.601504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 470/947] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:08.271863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:08.272520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:08.279942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.281076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.281922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.282419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.420180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:08.428245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f8595e6-5cb4-49b0-bf7f-711b203d1a9d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160110 Jul 21 22:42:08.428836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 478/948] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:08.467261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:08.468887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:08.475561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.476012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.476810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.477246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.506250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-527a9df8-2497-49a2-b60d-245221ed5154 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Jul 21 22:42:08.506809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 471/949] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:08.613271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:08.614002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:08.620744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.621452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.622262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:08.622696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:08.655606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc32cd38-80d5-43f4-9bd5-b428121c62c5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046139 Jul 21 22:42:08.656188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 479/950] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:09.445370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:09.446013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:09.452660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.453222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.454184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.454710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.519664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:09.520711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:09.527154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.527598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.528374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.528837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.559486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f331a195-b810-4780-be84-4ac896f2a086 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045397 Jul 21 22:42:09.560054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 480/951] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:09.588158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:09.595878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-40a80f31-6e2e-404f-95f1-ee114d8636c4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154351 Jul 21 22:42:09.596470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 472/952] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:09.667354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:09.668267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:09.674528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.674970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.675718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:09.676149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:09.705976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b512e7b-dc81-4683-8185-d5e3290bb8aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042451 Jul 21 22:42:09.706439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 481/953] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:10.571908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:10.572891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:10.580082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.580546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.581313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.581741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.610778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8e952a2b-eb4d-4ad4-b239-0a255d7365a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 Jul 21 22:42:10.611425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 473/954] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:10.613368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:10.613986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:10.620397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.620877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.621894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.622325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.717448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:10.718915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:10.724831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.725276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.726033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:10.726464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:10.757324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6a319eec-f200-48b0-8498-2f188fbca9cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043760 Jul 21 22:42:10.758225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 474/955] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:10.760120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:10.768358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-deb4f485-46f1-4d97-a9d9-b5cc69c27d0c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158881 Jul 21 22:42:10.768945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 482/956] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:11.622623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:11.623574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:11.630973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.631443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.632221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.632694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.662908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb998194-d620-40aa-b13b-64abf538ea41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Jul 21 22:42:11.663468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 475/957] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:11.769267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:11.770181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:11.776079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.776551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.777305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.777731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.787905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:11.788545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:11.794567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.795017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.796452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:11.797105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:11.807437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3938128c-bc1e-46f2-8faa-178ced709866 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042326 Jul 21 22:42:11.808210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 483/958] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:11.928710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:11.936261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d4428e38-83f7-4fa9-a50f-51a5cb88327e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152193 Jul 21 22:42:11.937457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 476/959] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:12.675852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:12.676735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:12.683173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.683622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.684404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.684881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.717721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-19a66b31-7853-487e-b34c-692cc92a846c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Jul 21 22:42:12.719024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 484/960] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:12.819142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:12.820172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:12.827999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.828459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.829344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.829920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.861592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ab65cb0b-99fe-442c-8ada-6a7670f1a20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046455 Jul 21 22:42:12.862169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 477/961] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:12.953939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:12.954505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:12.960968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.961412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.962167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.962596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.097368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:13.104885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3caabf1f-690d-41ce-b987-00cc1b8ba446 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154917 Jul 21 22:42:13.105453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 485/962] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:13.730361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:13.731199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:13.737715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.738171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.739107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.739615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.770692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-497a5a58-bfa6-4993-a897-1389ab5a3fc1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Jul 21 22:42:13.771254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 478/963] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:13.874653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:13.875716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:13.881878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.882316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.883080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:13.883508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:13.915868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e081445e-7315-4c17-8966-00039e283678 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045826 Jul 21 22:42:13.916445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 486/964] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:14.122621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:14.123215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:14.129969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.130414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.131178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.131608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.283226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:14.291440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f34c1a1c-353f-496d-be5e-a96aa47dbade tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.172816 Jul 21 22:42:14.292043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 479/965] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:14.783628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:14.784511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:14.791278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.791717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.792517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.792952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.824367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0a4e9058-c4cd-43df-862d-413894d5f3cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Jul 21 22:42:14.824978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 487/966] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:14.928861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:14.929787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:14.935982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.936962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.938315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.938753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.971185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-21532103-8c7d-4344-8976-6de5335ae0be tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046331 Jul 21 22:42:14.971770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 480/967] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:15.308201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:15.308827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:15.315707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.316150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.316955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.317391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.459670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:15.467422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4ba203e4-73a9-44a0-8d2e-bcdd7b656e66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.163016 Jul 21 22:42:15.468978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 488/968] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:15.837543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:15.838535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:15.846272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.846719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.847513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.847962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.882235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-414e2b25-9c5a-45ef-9e2b-a6ebb40b4503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048730 Jul 21 22:42:15.882823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 481/969] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:15.982335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:15.983776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:15.990290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.990768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.991526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.991954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.023771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d75874f7-6841-4cb8-8a20-68ddf79227e2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Jul 21 22:42:16.024359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 489/970] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:16.485233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.485873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.492023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.492468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.493270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.493699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.644391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:16.646679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:16.653446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2dc5254f-d2fd-4a4d-afea-7db3d035eca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.172060 Jul 21 22:42:16.654049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 482/971] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:16.894511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.895505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.901771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.902226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.903011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.903453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.937365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-53c4b8ee-dc11-4291-aa7d-cc7b55e4fee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046512 Jul 21 22:42:16.937592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 490/972] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:17.037977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:17.038903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:17.046586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.046920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.047706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.048141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.078284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-82b47754-87a3-4096-83ad-8dbec5c8b942 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Jul 21 22:42:17.078861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 483/973] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:17.671879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:17.672505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:17.678498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.678940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.679706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.680135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.832830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:17.840616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-06850597-236b-4a2b-9dec-dce3332304f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.173287 Jul 21 22:42:17.841203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 491/974] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:17.949990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:17.951483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:17.959200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.959680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.960447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:17.960901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:17.993401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-877cc825-e0e6-4aab-81ff-974e61758104 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048248 Jul 21 22:42:17.993983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 484/975] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:18.090593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:18.091526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:18.098597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.099036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.099796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.100231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.137823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-48eab266-f265-43dc-a731-2fbf26209e1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051174 Jul 21 22:42:18.138425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 492/976] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:18.858730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:18.859625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:18.867675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.868117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:18.868943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:18.869376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.006934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:19.007985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:19.015301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.015761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.016574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.017014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.022080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:19.031350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-60bdf279-9ada-4b71-b317-f8a2d65bed32 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.176433 Jul 21 22:42:19.031944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 485/977] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:19.050038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5f56f3e-5d12-4ac4-a8fd-011251decf33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047826 Jul 21 22:42:19.050621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 493/978] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:19.150833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:19.151931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:19.158771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.159316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.160272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:19.160695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:19.193369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d22b3788-d51c-4acc-bc0e-73710f723527 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046636 Jul 21 22:42:19.193952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 486/979] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:20.062245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:20.063164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:20.069579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.070025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.070784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.071211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.100600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-21883753-cd46-4018-8973-fec26bf2d5a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042146 Jul 21 22:42:20.101157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 487/980] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:20.205258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:20.206177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:20.211834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:20.212340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.212612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:20.212777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.213541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.213972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.220425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.220914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.221696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:20.222148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:20.225036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:20.253272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8db0c227-ef5a-435f-8f6d-fc2a5e8c254d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052006 Jul 21 22:42:20.253854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 488/981] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:20.368101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:20.376178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3bcba148-e5cd-4a47-bdba-61a13abdbc3f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.331499 Jul 21 22:42:20.376791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 494/982] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:21.112879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:21.113841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:21.120462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.120941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.121971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.122407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.151332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-65747abd-dd37-408f-860a-b910b28fce75 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jul 21 22:42:21.151815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 489/983] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:21.264858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:21.265945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:21.272757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.273202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.273960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.274388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.303795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-03b2f67d-7be5-4a5a-8849-122ce2bbe26e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042880 Jul 21 22:42:21.304344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 495/984] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:21.393637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:21.394251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:21.400250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.400731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.401555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:21.401932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:21.533485 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:21.541206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6c9ead9-7748-4694-b6dd-c2247c6cea72 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151874 Jul 21 22:42:21.541769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 490/985] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:22.162968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:22.163881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:22.171419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.171943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.172794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.173236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.204639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-83451512-69f5-4e8f-b278-700c42119ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Jul 21 22:42:22.205227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 496/986] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:22.317569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:22.319416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:22.327165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.328106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.328894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.329336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.361895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4abfd85b-bc15-4d17-b864-f1ea3f8e0397 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050325 Jul 21 22:42:22.362554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 491/987] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:22.558853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:22.559465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:22.566371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.566816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.567590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:22.568017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:22.700803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:22.708868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-04085333-6703-4e5d-8c0b-a9e54c4eeaef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153897 Jul 21 22:42:22.709703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 497/988] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:23.213284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:42:23.214751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments (ip 10.222.0.42) !!! Jul 21 22:42:23.217270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:23.219519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:23.226634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.227156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.228263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.228738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.259309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9f7d552a-7089-4f72-952a-cbec55060dec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046699 Jul 21 22:42:23.259875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 492/989] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:23.374812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:23.376093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:23.383104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.383552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.384328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.384806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.415741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-58974c38-8866-481e-8f62-2b9d31db8caf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045836 Jul 21 22:42:23.416314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 498/990] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:23.726020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:23.726624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:23.733478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.733977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.734798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:23.735294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:23.872471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:23.880552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-315c47d9-1be1-4949-a40f-2c362da5e866 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158398 Jul 21 22:42:23.881142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 493/991] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:24.270468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:24.271813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:24.277960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.278501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.279190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.280343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.309526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b8937426-4438-4f23-852f-da78945ed61e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Jul 21 22:42:24.310090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 499/992] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:24.430904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:24.431958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:24.438947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.439389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.440156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.440615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.470381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-400f7d17-500a-46a1-8f3e-292f08029afc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043469 Jul 21 22:42:24.470943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 494/993] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:24.899262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:24.899875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:24.906318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.906792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:24.907686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:24.908158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:25.047109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:25.054199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3c7e952e-b35d-4604-b130-3db0fad7885d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158857 Jul 21 22:42:25.054766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 500/994] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:25.321215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:25.322241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:25.329155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:25.329617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:25.330379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:25.330816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:25.363827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-583b9981-3bf3-493c-b0d7-1d4363cdea09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046481 Jul 21 22:42:25.364385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 495/995] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:25.482140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:25.483050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:25.490456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:25.490905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:25.491662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:25.492097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:25.521811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42baac87-4164-4410-97a9-d40439fde7d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043651 Jul 21 22:42:25.522352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 501/996] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:26.072755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:26.073303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:26.080584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.081034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.081801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.082236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.214433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:26.222538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ff3c7c18-58c7-4813-a87d-ea9e5b505407 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153741 Jul 21 22:42:26.223115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 496/997] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:26.376402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:26.377263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:26.383310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.383756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.384549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.384985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.413275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-68b6bcb3-955c-46d6-a434-9f1ea8c6dd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041924 Jul 21 22:42:26.413826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 502/998] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:26.533570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:26.534482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:26.540980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.541419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.542171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:26.542600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:26.572011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-01b0b6c1-7538-4d94-8111-c9fb6463ec48 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042415 Jul 21 22:42:26.572587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 497/999] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:27.240149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:27.240756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:27.247313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.247754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.248524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.248953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.380216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:27.387873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bd2ab8ad-a389-472f-8299-fa15ffd823f9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151768 Jul 21 22:42:27.388432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 503/1000] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:27.425521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:27.426466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:27.432529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.432980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.434048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.464152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2ec1876d-f6fe-47f2-8ecd-1f0efe73e370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043286 Jul 21 22:42:27.464740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 498/1001] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:27.583463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:27.584382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:27.590448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.590900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.591688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:27.592148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:27.627734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc6bed9e-4a3c-4d2d-b119-34b07c0c2fb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048208 Jul 21 22:42:27.628330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 504/1002] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:28.404668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:28.405255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:28.411974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.412421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.413210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.413659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.428800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:28.475363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:28.476294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:28.478769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=82 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:28.484760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.485216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.485994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.486433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.518107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-38d11409-9f33-4840-838f-ecad5e43c0ad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046686 Jul 21 22:42:28.518884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 505/1003] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:28.552252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:28.559788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-65b60904-585f-4eb7-8132-2abd1f567d29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159029 Jul 21 22:42:28.560351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 499/1004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:28.639032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:28.640195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:28.646608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.647053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.647824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:28.648260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:28.677223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac042aa8-1b84-4f09-a23a-7972d3ee120b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042017 Jul 21 22:42:28.677696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 506/1005] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:29.529631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:29.530555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:29.538251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.538703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.539469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.539904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.569184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c6f97ac-7c89-4770-bcc8-01dd1dae3249 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043491 Jul 21 22:42:29.569734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 500/1006] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:29.578137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:29.578776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:29.585122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.585566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.586315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.586749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.689829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:29.690668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:29.696750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.697198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.697969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:29.698401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:29.717606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:29.725977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7db02786-529d-424a-8cbf-815d51449c69 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152241 Jul 21 22:42:29.726538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 507/1007] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:29.728389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d91b5178-fb5c-4852-8a86-e43b4b2b542f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043295 Jul 21 22:42:29.728965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 501/1008] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:30.580074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:30.581038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:30.587727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.588167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.588969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.589400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.620539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f3f7079b-9ced-4d23-8ce2-62c20823a4df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Jul 21 22:42:30.621099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 508/1009] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:30.740824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:30.741738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:30.742573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:30.743190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:30.748625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.748991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.749979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.750104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.750368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.750499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.751223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:30.751657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:30.779972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c39ee29-a1fd-4941-9d85-9ca3e46c2dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043127 Jul 21 22:42:30.782098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 502/1010] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:30.888424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:30.896449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ed98363e-ca76-4967-ae49-ef94823ad04e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157601 Jul 21 22:42:30.897034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 509/1011] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:31.632734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:31.633663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:31.639818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.640411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:31.641195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.641687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:31.670651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f11dcf8b-0285-4df3-9e34-ebb096b11e79 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 Jul 21 22:42:31.671779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 503/1012] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:31.793598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:31.794513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:31.801664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.802110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:31.802868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.803297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:31.828279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:31.833474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a380f82a-45bb-4895-b1de-552d8e49e799 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043993 Jul 21 22:42:31.834043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 510/1013] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:31.913805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:31.914476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:31.920863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.922296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:31.922774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:31.923209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:32.056533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:32.064405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8cde7642-253a-4f12-a7a8-cdc96df2b583 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154508 Jul 21 22:42:32.064992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 504/1014] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:32.683000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:32.683962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:32.690664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:32.691106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:32.691867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:32.692294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:32.721343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0cc4f90d-ec7f-4d83-b201-fd9bcbea3f6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Jul 21 22:42:32.721904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 511/1015] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:32.845294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:32.846209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:32.848270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=86 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:32.853572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:32.854021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:32.854772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:32.855201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:32.892055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-402f35e8-ddc8-47e7-8bbb-c4c4a5411511 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050731 Jul 21 22:42:32.892678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 505/1016] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:33.081006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:33.081610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:33.087936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.088381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.089183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.089617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.219697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:33.227544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4f60c63b-77c5-4599-b276-0c0eb363ce11 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150589 Jul 21 22:42:33.228115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 512/1017] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:33.733040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:33.733896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:33.741078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.741525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.742285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.742717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.772492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eeed256b-2bc5-4165-9d71-b515f8a63bd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043524 Jul 21 22:42:33.773060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 506/1018] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:33.903826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:33.904757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:33.911792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.912348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.913019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:33.913451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:33.944292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d8fd728d-4c0b-407d-84a3-a0dd48e3ba1e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044434 Jul 21 22:42:33.944882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 513/1019] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:34.245267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:34.245865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:34.252642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.253091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.253848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.254276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.388464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:34.396676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ec4f2130-46de-4102-b389-69cb17b7dca5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155241 Jul 21 22:42:34.397242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 507/1020] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:34.784668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:34.786787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:34.791987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.792452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.793218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.793650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.824114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f28d51d8-570e-44aa-abc4-ab2c3873eee2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Jul 21 22:42:34.824692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 514/1021] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:34.956319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:34.957284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:34.963715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.964171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.964978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:34.965418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:34.995129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0062ca43-58ff-4a24-94c3-80bc0f410cff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043089 Jul 21 22:42:34.995683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 508/1022] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:35.413688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:35.414297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:35.420523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:35.420974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:35.421837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:35.422290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:35.557217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:35.565369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ceee2c9e-6789-4bd4-a36a-0b785add4988 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155504 Jul 21 22:42:35.565932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 515/1023] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:35.836198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:35.837145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:35.844118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:35.844290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:35.845077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:35.845516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:35.876694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-34540ea5-0029-4a28-ae8f-2fbf06317f08 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Jul 21 22:42:35.877220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 509/1024] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:36.007114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:36.008033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:36.014474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.015521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.016277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.016731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.044285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dd33c755-27b5-40e0-9e48-2c4acf1e0941 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041130 Jul 21 22:42:36.044857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 516/1025] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:36.581849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:36.582458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:36.588968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.589415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.590180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.590616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.731584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:36.740065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2b5b2be1-1bc8-4adc-941a-a21c1374e37f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.162153 Jul 21 22:42:36.740653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 510/1026] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:36.888724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:36.889656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:36.896700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.897147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.897908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:36.898336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:36.927155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8872754-281f-4c6c-97e5-23bd5cfc3cf5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Jul 21 22:42:36.927703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 517/1027] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:37.057488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:37.058414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:37.064699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.065152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.065915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.066358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.096085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5a386fa3-b381-4a2a-bd8b-a066e5bd49f9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042874 Jul 21 22:42:37.096670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 511/1028] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:37.757703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:37.758240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:37.764773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.765285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.766147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.766590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.901127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:37.909492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-912d689f-daa3-4903-af9a-a0ab5f7354a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155820 Jul 21 22:42:37.910062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 518/1029] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:37.939367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:37.940320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:37.946737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.947182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.947939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:37.948370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:37.977297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7b2c5565-c12e-4a27-aeba-b70b323ac3cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042054 Jul 21 22:42:37.977849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 512/1030] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:38.107352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:38.108275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:38.115468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:38.115914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:38.116703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:38.117141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:38.146863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-30b169c1-59fa-490c-9bff-51676885300a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043508 Jul 21 22:42:38.147632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 519/1031] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:38.927716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:38.928312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:38.934365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:38.934811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:38.935595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:38.936028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:38.990999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:38.991961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:38.999385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:38.999840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:39.000655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:39.001733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:39.031917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f953d011-5944-4bc3-a4bf-534c16fee384 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Jul 21 22:42:39.032605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 520/1032] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:39.071729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:39.079770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-88c729ac-c5e4-407f-9b10-697ea7ec33ba tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155970 Jul 21 22:42:39.080322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 513/1033] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:39.159264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:39.160107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:39.166102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:39.166542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:39.167299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:39.167720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:39.197200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d365c892-241a-4671-89a1-42368f201f1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042575 Jul 21 22:42:39.197747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 521/1034] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:40.043414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:40.044254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:40.051579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.052031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.052827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.053258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.083863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7d608205-8f16-41a1-a871-504afaf9da2d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Jul 21 22:42:40.084529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 514/1035] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:40.098143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:40.098969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:40.107309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.107811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.108714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.109696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.209322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:40.210268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:40.216359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.216852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.217633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:40.218076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:40.241226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:40.249075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-04a59e0a-6776-468e-8b20-7661549ae601 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156281 Jul 21 22:42:40.249688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 522/1036] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:40.250070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8605373-3e2c-4d89-8fbd-fe57b8a20f40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Jul 21 22:42:40.250678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 515/1037] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:41.095027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:41.095948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:41.101908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.102503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.103087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.103513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.133564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7090193e-d6d7-4dce-b6ed-93d96d994499 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Jul 21 22:42:41.134119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 523/1038] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:41.262145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:41.263648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:41.267016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:41.267633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:41.271079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.271609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.279171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.279171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.279598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.279598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.279598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:41.279598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:41.280949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:41.304446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bb32b920-9206-4e7c-8377-30c2215f1691 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046627 Jul 21 22:42:41.308265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 516/1039] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:41.410748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:41.418219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b937fe35-2132-48a8-be77-52bccdaba0da tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155626 Jul 21 22:42:41.418777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 524/1040] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:42.146260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:42.147189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:42.153385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.153838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.154601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.155042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.186017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-22f6bc63-0744-46f1-a62d-75b90be05cc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Jul 21 22:42:42.186585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 517/1041] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:42.316863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:42.318059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:42.324041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.324515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.325296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.325733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.358892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4fcf1b4e-6a1d-4bb2-b009-baa5ef8aba12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046896 Jul 21 22:42:42.359533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 525/1042] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:42.436305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:42.436977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:42.444171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.444654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.445418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:42.445855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:42.580139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:42.587665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d2e6c471-44d5-4326-ba59-7846ceb6adab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155183 Jul 21 22:42:42.588223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 518/1043] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:43.197011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:43.197840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:43.203920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.204361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.205140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.205567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.233962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42afb5df-a988-422d-a6d0-4ed534da1903 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041034 Jul 21 22:42:43.235507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 526/1044] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:43.370390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:43.371458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:43.378893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.378893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.379642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.380085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.419274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d411c6b7-c0dc-4dda-b6fd-0b00a46c1896 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052810 Jul 21 22:42:43.419921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 519/1045] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:43.604904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:43.605677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:43.612158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.612648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.613439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:43.613877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:43.629573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:43.748745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:42:43.749297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:42:43.757657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:43.765222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e648a002-0fda-448b-b0ae-7d702e1765d8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.164327 Jul 21 22:42:43.766403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 527/1046] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:44.245865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:44.246691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:44.254169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.254619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.255374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.255808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.286089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d207fac3-e9a5-4721-91c1-835dcca552e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044173 Jul 21 22:42:44.286652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 520/1047] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:44.431474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:44.432535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:44.439333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.439773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.440573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.441002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.469022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46cf7d50-7b9a-4e5b-8d89-188d75f607fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041439 Jul 21 22:42:44.469760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 528/1048] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:44.783560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:44.784146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:44.790421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.790868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.791630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:44.792065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:44.929486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:44.936976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3a00b57-5415-454d-8696-2de787b56dd6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157828 Jul 21 22:42:44.937533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 521/1049] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:45.298582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:45.299511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:45.305994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.306447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.307205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.307634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.338651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9d19cae1-e931-4dc4-99df-ba47243d50c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Jul 21 22:42:45.339268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 529/1050] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:45.481117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:45.481982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:45.488586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.489032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.489798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.490226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.520691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e196306d-9389-466f-87ce-ba922821b0f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043637 Jul 21 22:42:45.521258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 522/1051] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:45.954826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:45.955457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:45.961662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.962105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:45.962863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:45.963292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:46.099940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:46.108043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6c1255a-fedd-4390-b414-86d049b27594 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157680 Jul 21 22:42:46.108637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 530/1052] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:46.350863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:46.351826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:46.358002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:46.358544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:46.360152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:46.360809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:46.390498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0fb4a121-23b0-464c-9fab-985c3edd6b33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043543 Jul 21 22:42:46.391262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 523/1053] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:46.532279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:46.533309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:46.540395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:46.541196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:46.542552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:46.543038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:46.575042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8b9cfe0-420d-4321-87e3-8ecc14d55985 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047395 Jul 21 22:42:46.575621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 531/1054] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:47.127462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:47.128221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:47.136214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.136702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.137548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.137921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.298307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:47.306661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63ba0c68-b11f-45b9-9af0-0f5d7db2b9ae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.184018 Jul 21 22:42:47.307231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 524/1055] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:47.402787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:47.403619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:47.410313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.410752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.411513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.411941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.444058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-71e8cc38-a46a-419e-90ad-d4a2aebddcf3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Jul 21 22:42:47.444651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 532/1056] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:47.588115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:47.589052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:47.595146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.595593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.596355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:47.596819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:47.628901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f70060de-f2fc-4d0a-a561-65830888b7d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045130 Jul 21 22:42:47.629467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 525/1057] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:48.327354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:48.327993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:48.334500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.334944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.335704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.336138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.461142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:48.462085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:48.469531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.470028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.470574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.471020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.474704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:48.482914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b5d8355-94d6-41dd-b095-657ea033fdbf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159418 Jul 21 22:42:48.483488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 533/1058] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:48.506238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5c64f9f6-0d4b-43a9-b757-076f868732a4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049052 Jul 21 22:42:48.506811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 526/1059] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:48.641485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:48.642372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:48.648942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.649390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.650187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:48.650652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:48.681275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94595a3d-1d56-478f-a5a8-e19c10f3c8e8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044431 Jul 21 22:42:48.681833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 534/1060] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:49.500712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:49.501612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:49.507735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.508178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.508968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.509398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.518347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:49.519396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:49.525859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.526309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.527068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.527502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.557968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-29ef8459-c085-4307-91f3-cab768aea089 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Jul 21 22:42:49.561689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 535/1061] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:42:49.650470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:49.658557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-23c8c68b-80d0-4e8d-b645-75e7d2a5e692 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.162559 Jul 21 22:42:49.659127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 527/1062] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:49.694195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:49.695030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:49.701177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.701637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:49.702851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:49.732624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37264654-6e64-42e6-935a-80a609146fa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042439 Jul 21 22:42:49.733187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 536/1063] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:50.569593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:50.570521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:50.577048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.577501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.578268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.579331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.608774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7a3a858-9637-476c-ad8e-6e0a2c3ec370 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043060 Jul 21 22:42:50.609367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 528/1064] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:50.675063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:50.675819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:50.682274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.682711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.683529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.683904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.745040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:50.745965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:50.752766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.753217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.753990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:50.754456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:50.784264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7a30d08a-c698-4b93-8d7b-1ca8744cdd38 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043156 Jul 21 22:42:50.785102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 529/1065] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:42:50.818686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:50.826163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c7e443fc-ad05-49da-8c7c-0ba3b6797efc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155003 Jul 21 22:42:50.826725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 537/1066] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:51.620634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:51.621482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:51.628087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.628564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.629330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.629766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.659442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb8d3491-58a0-43c7-b3f5-c6273f7f2fea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042917 Jul 21 22:42:51.660014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 530/1067] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:51.796191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:51.797387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:51.804638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.805087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.805857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.806291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.843223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-34f59691-a57a-4ea9-a21d-9a96603a2a6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051006 Jul 21 22:42:51.843592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:51.847822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 538/1068] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:51.848065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:51.852591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.853160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.853970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:51.854411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:51.991852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:52.000143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-98fd7d98-001f-40e7-8f4f-7d066ffd7ab6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160778 Jul 21 22:42:52.000786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 531/1069] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:42:52.671432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:52.672540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:52.678432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:52.678869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:52.679621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:52.680058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:52.710264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-47504fa5-84ab-424c-818e-d869491b4566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042888 Jul 21 22:42:52.710809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 539/1070] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:52.856923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:52.857840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:52.864584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:52.865033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:52.865800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:52.866232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:52.891430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:52.897846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3ba431c-660f-48a9-945e-bfcb507751b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044959 Jul 21 22:42:52.898413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 532/1071] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:53.017997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:53.018549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:53.024925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.025372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.026128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.026577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.162973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:53.171821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-000651e3-43eb-4bae-9836-31cfd6b474c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158348 Jul 21 22:42:53.172536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 540/1072] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:53.722927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:53.723760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:53.729917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.730365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.731128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.731564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.760742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5a6e5971-400d-40a4-9b92-94a3827e7b7b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Jul 21 22:42:53.761287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 533/1073] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:53.909999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:53.910912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:53.917959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.918431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.919287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:53.919740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:53.955383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f8c44a77-995a-4872-8f8f-6916c255d97f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049737 Jul 21 22:42:53.955945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 541/1074] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:54.189620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:54.190230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:54.197010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.197463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:54.198238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.198675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:54.343699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:54.358119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-83202f6f-54e0-4868-bfe6-9e5f00d28f8c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.172253 Jul 21 22:42:54.359120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 534/1075] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:54.772183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:54.773122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:54.779821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.780266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:54.781168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.781590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:54.811723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92c4c000-08bc-4069-8e42-d388e55831eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Jul 21 22:42:54.812366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 542/1076] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:54.967264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:54.968229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:54.974678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.975122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:54.975876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:54.976302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:55.008772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-59694c27-e7ee-43d4-a9e1-58ff0326b7aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045303 Jul 21 22:42:55.009327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 535/1077] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:55.383119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:55.383728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:55.389738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:55.390177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:55.390929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:55.391353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:55.523229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:55.530693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9ae2df7d-2bcd-4db6-b4a0-099997572e45 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151394 Jul 21 22:42:55.531247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 543/1078] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:55.824081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:55.825024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:55.831665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:55.832108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:55.832897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:55.833326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:55.862953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-448e0a58-ebc2-4833-a3dd-d07f3dd1e9bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042776 Jul 21 22:42:55.863496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 536/1079] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:56.021131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:56.022086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:56.028540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.028984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.029743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.030175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.034508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:56.060359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7c8e86ed-7455-48a8-add1-a35faca6bcb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Jul 21 22:42:56.060993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 544/1080] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:56.547263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:56.547945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:56.554001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.554448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.555200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.555631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.687501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:56.695580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3dc9295c-9c87-4b68-9a39-8e85ca5db097 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152137 Jul 21 22:42:56.696138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 537/1081] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:56.874406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:56.875321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:56.882225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.882625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.883386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:56.883869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:56.913354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-24561fe2-7cfe-4da3-a0d6-8c3dfab9ce53 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Jul 21 22:42:56.913908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 545/1082] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:57.071496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:57.072442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:57.078932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.079890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.080699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.081139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.109751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a3f573a5-d1e5-43be-937b-4fa327c0bf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042261 Jul 21 22:42:57.111260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 538/1083] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:57.712468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:57.713031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:57.720046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.720790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.721406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.721834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.861850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:57.869459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ebefc586-0ecd-429c-9ba6-cbb05f0285fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161021 Jul 21 22:42:57.870031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 546/1084] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:57.925069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:57.925995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:57.931992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.932440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.933234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:57.933668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:57.962898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5f9b0cf9-5eda-4b04-a07f-c3cdb021983c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Jul 21 22:42:57.963377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 539/1085] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:58.122135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:58.123086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:58.130073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.130512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:58.131263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.131690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:58.160651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8c9d55e1-e67e-4b58-8092-6b23085012dc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042410 Jul 21 22:42:58.161190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 547/1086] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:42:58.887339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:58.887939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:58.896685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.897467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:58.898821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.899604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:58.975388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:58.976314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:58.978724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=86 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:58.984599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.985899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:58.986948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:58.986948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:59.021462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5e277c46-87fe-4d40-b30a-89a8a0f9481c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050253 Jul 21 22:42:59.022038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 548/1087] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:42:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:59.054365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:59.062497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1456884e-55c6-450e-a19c-259e0124738a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179002 Jul 21 22:42:59.063236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 540/1088] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:59.174533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:59.175370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:59.181773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:59.182227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:59.183010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:59.183446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:59.216370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-07f44d34-7b97-45dd-a7fe-ce0b62e6eeb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046494 Jul 21 22:42:59.216980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 549/1089] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:42:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:00.033189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:00.034055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:00.040579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.041030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.041781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.042213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.071669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6b0e3b00-f1be-49d2-9e3f-869e9bd92098 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042694 Jul 21 22:43:00.072231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 541/1090] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:00.079025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:00.079648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:00.086116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.086564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.087320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.087747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.216348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:00.224206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f0459294-cab8-413a-bfcd-2a8261094ae1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.149074 Jul 21 22:43:00.224798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 550/1091] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:00.228089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:00.229072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:00.235722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.236178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.237255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:00.237803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:00.269232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9c43c01-0c1c-40b9-b9b9-f8f91fa93d57 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044939 Jul 21 22:43:00.270042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 542/1092] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:01.083765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:01.084816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:01.091183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.091627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.092386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.092845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.124434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb53d8f7-7fc6-44d4-95ec-709008a254dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045020 Jul 21 22:43:01.125054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 551/1093] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:01.241615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:01.242159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:01.249216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.249658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.250444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.251409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.281080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:01.282014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:01.288897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.289346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.290102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:01.290531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:01.320280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4b58fe7a-3497-4fc0-9ef7-cb5cca4b61c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043098 Jul 21 22:43:01.320871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 552/1094] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:01.385721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:01.394194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-13ad7a64-9e9f-475e-9ca5-c55df32bdaed tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156567 Jul 21 22:43:01.394757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 543/1095] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:02.136738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:02.137667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:02.144682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.145138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.145898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.146333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.176394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fe0b0cbc-5942-47cf-b58f-452737f4921a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Jul 21 22:43:02.176975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 553/1096] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:02.332624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:02.333547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:02.340049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.340503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.341286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.341723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.372551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aeeac349-ab0d-404b-96f5-9bbab8e4b488 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Jul 21 22:43:02.373110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 544/1097] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:02.411959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:02.412509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:02.418538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.418980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.419735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:02.420161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:02.552990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:02.560429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-130f65f5-66e4-45a8-bba4-66f37a190602 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153134 Jul 21 22:43:02.561011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 554/1098] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:03.188033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:03.188924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:03.190790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=80 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:03.196188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.196678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.197438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.197870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.227538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-69dce251-cbbc-40c1-a793-67011554cd77 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Jul 21 22:43:03.228079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 545/1099] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:03.384877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:03.385834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:03.393451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.393890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.394643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.395071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.425735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08a076f3-46a1-4820-9095-2926dd443cf4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Jul 21 22:43:03.426290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 555/1100] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:03.577335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:03.577969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:03.584978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.585415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.586168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:03.586597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:03.719401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:03.727456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef08c860-1981-4f09-9173-fcc473a108fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153926 Jul 21 22:43:03.728025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 546/1101] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:04.240394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:04.241269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:04.247700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.248152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.249219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.249656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.280984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cfbc7c57-1207-4a0f-b36a-2b86e021f3df tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Jul 21 22:43:04.281559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 556/1102] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:04.438152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:04.439136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:04.445259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.445708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.446464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.446924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.476537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00e1078b-b988-466c-8cd3-c0a0bc3097d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042280 Jul 21 22:43:04.477093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 547/1103] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:04.745798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:04.746399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:04.753204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.753645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.754390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:04.754820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:04.899727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:04.910330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1cc8ca9a-0f11-4efe-90a2-25df166f55ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167719 Jul 21 22:43:04.911384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 557/1104] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:05.293246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:05.294200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:05.301584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.302035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.302793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.303223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.332431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d5b1865-f64b-40d1-954e-145fc99a0c16 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043131 Jul 21 22:43:05.333001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 548/1105] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:05.488881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:05.489831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:05.495867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.496313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.497113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.497544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.526179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-25f39b35-80d5-426b-9b38-92d0708b50ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041848 Jul 21 22:43:05.526728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 558/1106] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:05.935236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:05.935843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:05.941818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.942262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.943018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:05.943450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:05.958561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:06.079168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:06.090396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6105cc24-29ad-4189-a129-c353e2c18d2a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158767 Jul 21 22:43:06.091350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 549/1107] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:06.344779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:06.345739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:06.352959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:06.353405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:06.354202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:06.354632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:06.387004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-69a7fbd4-a61c-41e0-ae5e-60c1a96e20b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Jul 21 22:43:06.387620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 559/1108] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:06.538274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:06.539207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:06.545634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:06.546076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:06.546831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:06.547262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:06.576131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-af5eb51e-0fce-45b0-8479-ef5af32ce55d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042540 Jul 21 22:43:06.576695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 550/1109] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:07.108364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:07.109014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:07.114991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.115443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.116201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.116678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.242947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:07.245240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:07.252122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-84ba41e9-3133-4710-8fbb-474dfb1db039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.147593 Jul 21 22:43:07.252735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 560/1110] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:07.399073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:07.400126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:07.406427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.406866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.407625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.408057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.438081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-704be329-17de-49e5-ae82-4d1331c52508 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Jul 21 22:43:07.438646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 551/1111] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:07.587561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:07.588467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:07.594996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.595438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.596184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:07.596645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:07.625550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-49a689a9-6f15-45c0-9f82-161cd5ef3a07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041919 Jul 21 22:43:07.626105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 561/1112] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:08.270497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:08.271104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:08.277886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.278331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.279101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.279533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.432234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:08.436747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2298a2b6-fabe-4d3f-8e50-e229ea4617cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.170854 Jul 21 22:43:08.437332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 552/1113] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:08.450400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:08.451319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:08.458061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.458508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.459276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.459703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.491515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-174fdc22-47bf-4a62-b4f6-2be650e7ba8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Jul 21 22:43:08.492281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 562/1114] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:08.638730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:08.639644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:08.646852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.647303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.648077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:08.649185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:08.681116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d2c0311-4f03-46a5-8736-17d62d256060 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046537 Jul 21 22:43:08.681694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 553/1115] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:09.453148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:09.453756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:09.460391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.460889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.461647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.462076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.503452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:09.504383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:09.511088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.511533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.512308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.512775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.544022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e2bdf0df-0c64-41e1-8d40-843e599723c0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Jul 21 22:43:09.544837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 554/1116] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:09.601864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:09.611888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc386a20-210d-4c7f-a956-53b7e0b88224 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.162503 Jul 21 22:43:09.612906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 563/1117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:09.693393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:09.694276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:09.700469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.700963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.701731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:09.702151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:09.733072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-af7dc0b9-5f00-4706-a72e-06f8271f0341 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044467 Jul 21 22:43:09.733659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 555/1118] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:10.555683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:10.556639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:10.563148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.563593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.564384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.564846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.593337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-79c4539f-0c80-43f9-869f-d8d0820bb841 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041658 Jul 21 22:43:10.593884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 564/1119] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:10.629072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:10.629671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:10.636103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.636585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.637340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.637801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.745278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:10.746279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:10.752725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.753268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.754747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:10.755251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:10.783991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3f6c3cb6-9dec-492b-a0aa-afdecfa94bdd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042562 Jul 21 22:43:10.784565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 565/1120] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:10.791028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:10.798631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ff730eaf-1fe0-4b82-bb8b-2ab06c11effd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.173443 Jul 21 22:43:10.799215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 556/1121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:11.606593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:11.607526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:11.614508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.614958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.615752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.616210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.649416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f5e67607-51c2-492b-8f67-c4234905759d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046708 Jul 21 22:43:11.650005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 566/1122] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:11.797261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:11.798520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:11.805255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.805693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.806449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.806878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.815602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:11.816217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:11.823322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.823771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.824568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:11.824993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:11.837089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9edb3026-69b3-4800-95ed-f4e63e93db4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045418 Jul 21 22:43:11.837651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 557/1123] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:11.954464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:11.961955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e43f8fda-ba22-4903-a492-e1dfe39795bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150318 Jul 21 22:43:11.962511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 567/1124] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:12.660770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:12.661697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:12.667859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.668308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:12.669130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.669566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:12.700867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c55b2980-18ee-4e4c-aa68-0f5bae8b3556 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044147 Jul 21 22:43:12.701349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 558/1125] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:12.848290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:12.849222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:12.855650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.856094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:12.856867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.857295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:12.886578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5f3bf369-bb12-4240-b383-79a8d3edaec5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042189 Jul 21 22:43:12.887138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 568/1126] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:12.979000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:12.979539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:12.985916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.986366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:12.987126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:12.987556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:13.119588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:13.127276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9b2f3bbf-13f1-401e-8c9f-363d116718de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152195 Jul 21 22:43:13.127860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 559/1127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:13.712788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:13.713608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:13.719922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:13.720606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:13.721168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:13.721600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:13.751500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3760f70f-d39c-454a-ba48-5dbdfdc9ba15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jul 21 22:43:13.752051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 569/1128] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:13.897495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:13.898417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:13.904531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:13.904986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:13.905747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:13.906183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:13.939884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dc705d9d-32f2-49e5-a468-9c5de86793b7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046332 Jul 21 22:43:13.940435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 560/1129] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:14.144865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:14.145519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:14.151832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.152275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.153057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.153485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.287561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:14.295204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ee2df30b-c612-4873-b84d-990f02587c20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154647 Jul 21 22:43:14.295764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 570/1130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:14.764057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:14.764920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:14.773492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.773944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.774718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.775153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.805656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d85e65d5-07ce-422b-9f43-e4ffe8f02cff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Jul 21 22:43:14.806257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 561/1131] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:14.951741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:14.952680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:14.959261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.959698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.960444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:14.960896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:14.989496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3d2e73ee-b70b-42b9-a7a5-6ca55e8a8b40 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041990 Jul 21 22:43:14.990046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 571/1132] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:15.311540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:15.312181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:15.319274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:15.319721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:15.320502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:15.320941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:15.459494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:15.466926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ffdb76d1-30c4-4438-8085-e244fa44852e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159239 Jul 21 22:43:15.467482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 562/1133] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:15.817361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:15.818307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:15.824739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:15.825180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:15.825927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:15.826352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:15.854199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-adcc2c3e-c12d-4d5e-bba4-aa2a335482c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041446 Jul 21 22:43:15.854737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 572/1134] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:16.001540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:16.002489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:16.009543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.009992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.010748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.011178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.040895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3e649c87-3b7d-4130-81a7-ba85e897a2c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043512 Jul 21 22:43:16.041442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 563/1135] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:16.483080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:16.483685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:16.490155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.490609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.491365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.491794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.620003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:16.627763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f8ba696c-b43c-416c-960c-0324910f7206 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.148545 Jul 21 22:43:16.628328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 573/1136] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:16.866106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:16.867246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:16.873735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.874437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.875222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:16.875658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:16.906742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3abb24a5-7174-46ff-96ad-b3eca05d497a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Jul 21 22:43:16.907305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 564/1137] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:17.052799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:17.053711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:17.060149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.060635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.061393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.061825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.091267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1a749579-ecd3-4bff-89b2-437c41480f79 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042545 Jul 21 22:43:17.091814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 574/1138] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:17.644876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:17.645730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:17.653050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.653498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.654267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.654704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.790936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:17.798468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1192e982-bebd-439f-ab04-07489076575f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157501 Jul 21 22:43:17.799031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 565/1139] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:17.918723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:17.919636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:17.925706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.926174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.927140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.927716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.955777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3c153c59-97f0-40c2-88fe-5701269ac6bf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040970 Jul 21 22:43:17.956325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 575/1140] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:18.103837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:18.104782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:18.110969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.111413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.112179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.112644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.115189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:18.144464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1104652d-ddb7-4a3c-86fd-5f46bb562410 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044803 Jul 21 22:43:18.145075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 566/1141] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:18.815714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:18.816344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:18.823541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.823992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.824779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.825220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.960740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:18.968779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:18.969362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-af84a608-6057-4b70-ba90-1f597b44a35c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156845 Jul 21 22:43:18.969651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 576/1142] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:18.969765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:18.976562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.977028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.977769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.978200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.009934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-164ec319-54c1-4aa6-825c-3cb621a833e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Jul 21 22:43:19.010489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 567/1143] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:19.157303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:19.158171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:19.165278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.165728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.166500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.166933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.181971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:19.200879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3693fdb2-0efa-4687-b15f-ed94a43b3394 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047588 Jul 21 22:43:19.201445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 577/1144] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:19.986444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:19.987059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:19.993820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.994261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.995013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.995440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.022034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:20.022995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:20.029408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.029910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.030607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.031032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.060643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ffd30ac0-1389-40f1-b06b-4c200054d806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Jul 21 22:43:20.061312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 578/1145] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:20.129290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:20.138133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4db24351-f76f-4f2c-b6bc-5c48f68ceb00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155674 Jul 21 22:43:20.138697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 568/1146] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:20.213224 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:20.214146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:20.220217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.220701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.221464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.221895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.252220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a0590b40-b7fc-49e1-a980-02032176f1d4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042882 Jul 21 22:43:20.252797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 579/1147] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:21.073064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:21.073981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:21.080406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.080877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.081683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.082113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.109709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3e4bb10b-c284-4dbc-aec0-34a9d4d0b74a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Jul 21 22:43:21.110253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 569/1148] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:21.156567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:21.157094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:21.163593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.164040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.164813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.165244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.265067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:21.266203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:21.273007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.273551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.274331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.274771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.302336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:21.311449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac52d4b3-d2d7-476e-b71b-db9e9e105ec5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158806 Jul 21 22:43:21.312312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 580/1149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:21.313306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb1fefb9-e7b9-4a59-a2f4-67438afc18d0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052191 Jul 21 22:43:21.313883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 570/1150] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:22.123331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:22.124599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:22.130774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.131226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.132001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.132964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.162488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2dcbd994-c618-4ab8-8ab1-dda844aa573b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Jul 21 22:43:22.163137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 581/1151] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:22.326398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:22.328285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:22.331619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:22.332454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:22.335270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.336362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.337172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.337602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.339956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.340457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.341335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:22.341964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.368149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cf3556e0-7b5e-4ab3-95df-abc85edd807b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046242 Jul 21 22:43:22.368749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 571/1152] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:22.472571 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:22.480080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b1d9d13e-a790-4c62-bfb6-ab6135da62be tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154454 Jul 21 22:43:22.480686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 582/1153] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:23.174641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:23.175563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:23.181622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.182062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.182817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.183246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.213646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-56c07d3d-fdaa-4f15-86ee-9243c72b0cb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 Jul 21 22:43:23.214437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 572/1154] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:23.380397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:23.381349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:23.388904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.389353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.390121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.390562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.421700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf7d8189-617b-4492-a9ff-ffc2ad064e3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045174 Jul 21 22:43:23.422197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 583/1155] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:23.500612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:23.501215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:23.508244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.508720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.509500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.509944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.643951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:23.652188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c5b142d8-7c50-4ee3-bab4-bfcc465dbc4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155953 Jul 21 22:43:23.652785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 573/1156] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:24.225812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:24.226953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:24.232928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.233395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.234149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.234577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.265144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-35a43b5b-178d-42a8-8738-4541aad55866 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Jul 21 22:43:24.265725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 584/1157] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:24.434088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:24.434638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:24.440665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.441108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.441861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.442290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.471337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-01645827-8701-4b32-a036-b27ce2ec470c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042049 Jul 21 22:43:24.471883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 574/1158] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:24.669673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:24.670311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:24.677123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.677577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.678347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.678784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.815966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:24.824082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cf88a046-40af-48ea-98d9-b1b3a879e33f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158308 Jul 21 22:43:24.824659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 585/1159] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:25.276462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:25.277329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:25.283980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.284426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.285256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.285694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.317316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-02c9a311-18e8-4f68-bfdf-0abcbed4d54a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Jul 21 22:43:25.317883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 575/1160] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:25.483795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:25.484736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:25.490758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.491197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.492359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.492817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.521332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0c068866-8160-4b28-91ef-12e450a57c27 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041576 Jul 21 22:43:25.521888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 586/1161] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:25.841450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:25.842055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:25.847991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.848433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.849219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.849647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.978995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:25.986488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2d0f1df2-c2a6-4ec3-9c2f-6b0786340add tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.148865 Jul 21 22:43:25.987040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 576/1162] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:26.328882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:26.329823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:26.336291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.336761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.337533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.337961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.368995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9ec0542f-5298-4b96-a48c-b9078b53ed6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044017 Jul 21 22:43:26.369573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 587/1163] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:26.533858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:26.534787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:26.541977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.542432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.543203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.543639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.573370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18164126-da8b-4757-bb17-de45c3fe8ce9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043541 Jul 21 22:43:26.573937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 577/1164] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:27.004063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:27.004720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:27.011007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.011448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.012208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.012699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.150771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:27.158524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08be7b5c-fc32-4edd-a6fc-a34965a59039 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158264 Jul 21 22:43:27.159002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 588/1165] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:27.381016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:27.381968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:27.388097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.388591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.389365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.389806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.420018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2ce052c0-2cca-496a-8073-8dd7709e70b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Jul 21 22:43:27.420822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 578/1166] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:27.589431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:27.591112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:27.598430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.598883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.599659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.600097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.630477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-df99cc72-8a0e-4137-b7f9-c23fb505fcfe tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049173 Jul 21 22:43:27.631045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 589/1167] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:28.176454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:28.177101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:28.184291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.184775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.185548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.185987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.327920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:28.336296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-98082c5f-00cb-4f9c-8b45-112889fc7498 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.163049 Jul 21 22:43:28.337037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 579/1168] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:28.432996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:28.433877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:28.440146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.440618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.441391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.441819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.472973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ee3c699d-f7dc-44a2-bdee-d7feaf6c257c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Jul 21 22:43:28.473554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 590/1169] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:28.642663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:28.643602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:28.650577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.651026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.651795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:28.652254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:28.684105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2c027f95-13a8-4a6c-b3e8-4fe03700b974 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045341 Jul 21 22:43:28.684620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 580/1170] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:29.354773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:29.355381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:29.357838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=86 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:29.363601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.364039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.364920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.365480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.488489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:29.489453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:29.497088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.497538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.498315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.498750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.531530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2c0cf1e7-83a0-42a2-9e1d-1a9fcd492115 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049738 Jul 21 22:43:29.532126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:29.696144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:29.697030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:29.703569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.703976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.704830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.705266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.725463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:29.731689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:29.734156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-877cddfc-323d-4d7d-963e-e74f463f082c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.383667 Jul 21 22:43:29.734743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:29.737414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb3a6a6b-9e4d-4303-b0a9-efcf595408ea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045844 Jul 21 22:43:29.738004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 582/1173] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:30.543578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:30.544531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:30.551782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.552225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.553040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.553469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.585915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f7ffccb7-27cc-4c7b-bf68-c472891050d7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046363 Jul 21 22:43:30.586721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:30.749516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:30.750633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:30.752959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:30.753611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:30.757654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.758115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.758900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.759343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.759946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.760390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.761193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.761643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.794402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4f163206-4562-418c-93e0-3492d0eae57e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049040 Jul 21 22:43:30.795002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 583/1175] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:30.920804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:30.929601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b3555e21-f488-4769-8c14-23bd438dd784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.180905 Jul 21 22:43:30.930183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:31.597143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:31.598089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:31.604447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.604937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.605740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.606180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.798669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0c05fbcb-5708-483a-b68b-af4c8ed30f33 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205123 Jul 21 22:43:31.799719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:31.808280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:31.809296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:31.816759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.817211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.818006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.818450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.822210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:31.856131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a9a72a4b-872e-44e2-b82f-036bc7e3473b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053172 Jul 21 22:43:31.856773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 594/1178] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:31.947935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:31.948576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:31.955035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.955482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.956269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.956734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.099633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:32.111309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-621236d7-aaa2-41cd-a380-0c00a79ab7dd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167360 Jul 21 22:43:32.112087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 585/1179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:32.811944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:32.812900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:32.819655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.820131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.821225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.821665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.855033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9d793f44-3267-49c0-bdb7-254518d0c4a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047033 Jul 21 22:43:32.855615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:32.867357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:32.868277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:32.875720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.876172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.876997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.877433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.911241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-111543e8-a154-4af9-ad00-060e2d1b2a72 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047799 Jul 21 22:43:32.911843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 586/1181] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:33.130511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:33.131031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:33.140411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.140962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.141928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.142426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.296540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:33.305439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dd4abb55-cb1d-42c4-889e-71f86324af70 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.178151 Jul 21 22:43:33.306025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:33.866346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:33.867982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:33.870107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=84 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:33.876777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.877234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.878029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.878470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.911473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7fb9b65-f220-4c94-ace8-753c046578be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049098 Jul 21 22:43:33.912068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:33.927822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:33.930944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:33.939511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.940006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.940889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.941591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.975296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-73e4cb8b-ecd1-4853-a81d-2fbc27ac8731 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055618 Jul 21 22:43:33.975878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 597/1184] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:34.325716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:34.326522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:34.333024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.333474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:34.334257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.334695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:34.485237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:34.494053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8cc2e910-4b41-4316-8b0f-9257fe436865 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.174782 Jul 21 22:43:34.494648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 588/1185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:34.927060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:34.928617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:34.939022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.939473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:34.940248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.940702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:34.973396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9e7569ab-1b13-4cac-b227-11e063eba3e2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053324 Jul 21 22:43:34.974058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 598/1186] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:34.989062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:34.990080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:34.998762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.999213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.000269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:35.000754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.034577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e6fbb2a-9a1a-475f-9b66-2637afdf0c5e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049785 Jul 21 22:43:35.035221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 589/1187] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:35.511915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:35.512569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:35.519098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:35.519552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.520353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:35.520861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.701798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:35.713041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1a8da545-c178-4b9c-82fc-73298c96d414 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.204907 Jul 21 22:43:35.713739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 599/1188] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:35.987008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:35.987872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:35.994381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:35.995364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.995615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:35.996058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:36.032081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bb5ee9e3-1729-4e8b-a491-0eb35019a381 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049051 Jul 21 22:43:36.032695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 590/1189] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:36.047594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:36.048559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:36.055781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:36.056227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:36.057056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:36.057496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:36.092011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37b86187-7686-4547-bb2e-5a255518ae6f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048667 Jul 21 22:43:36.092706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 600/1190] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:36.733544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:36.734077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:36.740552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:36.741007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:36.741861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:36.742915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:36.896985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:36.906605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-616e4575-e107-4d27-b1fd-520e0952e507 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.178213 Jul 21 22:43:36.907194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 591/1191] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:37.046366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:37.047302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:37.054749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.055818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:37.056076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.056610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:37.090637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-467b4c61-2733-48c0-85a3-ef8a3d17ef48 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048226 Jul 21 22:43:37.091219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 601/1192] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:37.104064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:37.105162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:37.113009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.113551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:37.114446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.114931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:37.150175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-27cdad41-cef4-40fe-b0ee-d126b305c859 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050531 Jul 21 22:43:37.150759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 592/1193] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:37.931963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:37.932608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:37.938950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.939403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:37.940186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:37.940667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:38.084190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:38.093462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b0e6d5ed-1b84-458b-a939-83eeba5891bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.166121 Jul 21 22:43:38.094044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 602/1194] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:38.103591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:38.104595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:38.111629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:38.112077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:38.112961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:38.113394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:38.145422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b618dfc9-f357-4eb5-9fc1-3a65dec15c03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046980 Jul 21 22:43:38.146006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 593/1195] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:38.162171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:38.163126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:38.170035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:38.170492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:38.171249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:38.171681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:38.204155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fd8c7224-35de-45bb-96d4-e09650914db7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045842 Jul 21 22:43:38.204737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 603/1196] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:39.112446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:39.113147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:39.121851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.122307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.123095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.123532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.163468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:39.167148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:39.178751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.179866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.180696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.181130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.214196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-17524276-e9d4-468e-8b2a-33d7cb96b915 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056609 Jul 21 22:43:39.214816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 604/1197] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:39.219598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:39.220535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:39.227686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.228288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.229103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:39.229547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:39.260861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4c850cc8-9f43-4a6a-818e-39712eea085a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044949 Jul 21 22:43:39.261444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 605/1198] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:39.279788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:39.292691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-92987ec4-3d5e-49d0-9437-81914b07b819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.183748 Jul 21 22:43:39.293459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 594/1199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:40.225908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:40.228004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:40.234624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.235076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.235884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.236313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.269003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f509b32-8361-4755-b45f-3f7ae47ea87f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Jul 21 22:43:40.269605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 606/1200] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:40.272707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:40.273727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:40.281320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.281767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.282566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.283000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.311129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:40.311737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:40.316543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9635907-b834-4f3c-85ff-c39c8c0744d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047986 Jul 21 22:43:40.317136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 595/1201] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:40.318061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.318660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.319529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:40.320080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:40.467541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:40.475231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37d8ecb3-8bc2-4ae1-b2cb-d6c3e6c25207 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.168035 Jul 21 22:43:40.475848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 607/1202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:41.280604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:41.281561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:41.288019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.288519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.289545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.289991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.320671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9e02fa76-05db-451f-ba51-9dea20ad74ef tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Jul 21 22:43:41.321233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 596/1203] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:41.329186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:41.330128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:41.336778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.337219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.337970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.338398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.371009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6f013ae0-b5b5-4c51-aea4-d951244e3d70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045652 Jul 21 22:43:41.371603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 608/1204] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:41.494982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:41.495633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:41.502192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.502778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.503678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:41.504213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:41.642729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:41.650296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-644a8847-2974-4cc1-a49d-151cc08337ce tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160898 Jul 21 22:43:41.650856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 597/1205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:42.332117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:42.333143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:42.341118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.341582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.342366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.342805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.372772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5baacd14-cf10-4f8d-ba58-30436507a67e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Jul 21 22:43:42.373338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 609/1206] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:42.383098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:42.384319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:42.391763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.392278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.393435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.393883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.425700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9c90f1a-8cf8-4c27-ac93-d31f36a2dbcf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047229 Jul 21 22:43:42.426279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 598/1207] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:42.667606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:42.668132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:42.674593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.675044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.675830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:42.676267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:42.810967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:42.813163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:42.820523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2f805ef9-f21d-4a80-90e5-6f78b0fee0fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156514 Jul 21 22:43:42.821334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 610/1208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:43.384846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:43.385768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:43.392843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.393300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.394079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.394576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.410547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:43.428132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4238e418-6a0c-42ea-8f6a-a0c2155dc148 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Jul 21 22:43:43.428726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 599/1209] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:43.438193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:43.439246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:43.446317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.446783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.447552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.447987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.478314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-49506e59-8f11-40f9-83ad-9519956b9eea tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044343 Jul 21 22:43:43.478869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 611/1210] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:43.837699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:43.838310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:43.844276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.844752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.845501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:43.845929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:43.985986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:43.991486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-23a58e7f-4f35-49cc-abb8-4e575f02aa10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157562 Jul 21 22:43:43.992055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 600/1211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:44.439417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:44.440337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:44.447433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:44.447874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:44.448680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:44.449134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:44.478277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ef16e63d-5823-4d02-ab8e-2893fc6dd03c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jul 21 22:43:44.478830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 612/1212] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:44.493769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:44.494719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:44.501626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:44.502080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:44.502854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:44.503289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:44.534751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2881d415-22ea-4517-84af-8fb7ad737d15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048205 Jul 21 22:43:44.535300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 601/1213] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:45.009886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:45.010494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:45.016965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.017465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.018343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.018872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.157294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:45.165794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-13bdd81c-9022-4ccd-b752-94e05ef4d638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159923 Jul 21 22:43:45.166424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 613/1214] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:45.489960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:45.490879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:45.497028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.497728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.498219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.498649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.530300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b4cda81f-2045-4b9e-b10c-5de5c84db7c6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Jul 21 22:43:45.530845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 602/1215] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:45.546175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:45.547223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:45.553607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.554053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.555311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:45.555877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:45.586990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-14d1bedc-e8bc-4dc6-bcbe-63ebc29dc353 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044199 Jul 21 22:43:45.587591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 614/1216] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:46.183122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:46.183729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:46.189720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.190163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.190954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.191415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.331762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:46.339488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7113664-0ea7-4d62-8b97-a99bf23e511a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160402 Jul 21 22:43:46.340046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 603/1217] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:46.541835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:46.543575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:46.549708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.550328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.550914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.551351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.587022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-06d6b54f-6190-43f9-bfb0-7b87ad7b7464 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048548 Jul 21 22:43:46.587597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 615/1218] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:46.598866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:46.599908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:46.607633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.608076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.608880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:46.609340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:46.640251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63444ea7-33a4-4a61-94c0-a03c64b34d4f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045346 Jul 21 22:43:46.640835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 604/1219] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:47.357280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:47.357998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:47.363855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.364300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.365109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.365549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.501739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:47.509748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6124cdc6-f944-4466-8ae3-f5fb97060245 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156390 Jul 21 22:43:47.510317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 616/1220] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:47.599144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:47.600085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:47.607537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.607911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.608722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.609161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.639717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f5629b70-14c2-4bfd-9d15-1971fd16c828 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Jul 21 22:43:47.640274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 605/1221] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:47.655596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:47.656540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:47.662527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.662969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.663726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:47.664154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:47.693844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb1e9798-6017-497d-afc8-a6e68eee48ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043306 Jul 21 22:43:47.694396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 617/1222] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:48.527001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:48.528760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:48.537479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.537925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.538705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.539127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.652758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:48.653692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:48.659927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.660602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.661168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.661705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.694598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1fc9b431-2071-41d4-bd64-154880228d5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046099 Jul 21 22:43:48.695097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 618/1223] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:48.704456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:48.707531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:48.708471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:48.713166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d4fb4790-a5d4-42b5-843b-b7810c419e7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.189484 Jul 21 22:43:48.713654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 606/1224] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:48.715206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.715661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.716467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:48.716938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:48.752080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9192cb55-f99a-4fa2-a16b-fdac3edd9b4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050106 Jul 21 22:43:48.752668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 619/1225] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:49.707300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:49.708159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:49.715253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.715702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.716502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.716936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.730603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:49.731208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:49.737517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.737961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.738743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.739164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.746578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c7bcf9e9-2301-4a14-8632-a7bc61c2addc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Jul 21 22:43:49.747134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 607/1226] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:49.764067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:49.765044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:49.771122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.771532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.772297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:49.772747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:49.802819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d1396b15-9b20-4c26-9157-ccef5a53a524 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042149 Jul 21 22:43:49.803379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 608/1227] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:49.871795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:49.879673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-36e86113-b320-40bd-be13-13ca91fb1db2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153001 Jul 21 22:43:49.880234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 620/1228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:43:50.759122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:50.760079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:50.766569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.767011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:50.767761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.768221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:50.796797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dba8c4d3-14e2-48fb-8965-a049c98a83b0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Jul 21 22:43:50.797338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 609/1229] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:50.814572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:50.815482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:50.822519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.822955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:50.823706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.824123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:50.852647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-07f76844-d20c-44c7-b757-c66eb0f22d6a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041845 Jul 21 22:43:50.853204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 621/1230] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:50.896948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:50.897558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:50.903659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.904105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:50.904894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:50.905326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:51.090903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:51.098336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef1d5e81-8dcb-4085-b6d8-f0d9a668d595 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.205297 Jul 21 22:43:51.098894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 610/1231] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:51.809319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:51.810355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:51.816980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:51.817601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:51.818157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:51.818584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:51.848540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dbce938f-776e-4c56-af18-10d64e07b126 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Jul 21 22:43:51.849106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 622/1232] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:51.863460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:51.864375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:51.872024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:51.876031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:51.876031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:51.876031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:51.905537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7efd085-5e06-449e-9147-8438f5334ea4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046096 Jul 21 22:43:51.906133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 611/1233] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:52.115681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:52.116197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:52.122903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.123343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.124091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.124545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.258588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:52.266727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4e70ac49-cb78-408c-b099-485a35dd30eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155030 Jul 21 22:43:52.267289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 623/1234] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:52.860445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:52.861399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:52.867990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.869717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.870514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.870959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.902319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-896fcd47-f1d6-4124-84f4-3755d656e112 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Jul 21 22:43:52.902898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 612/1235] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:52.917825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:52.918755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:52.925539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.926053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.926794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:52.927222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:52.958131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ba69f4ce-03c1-4291-ad7a-fd0ee8f89503 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Jul 21 22:43:52.958695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 624/1236] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:53.285090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:53.285711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:53.292777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.293226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.294005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.294439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.437508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:53.445078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-920e26a3-7598-4bd3-b494-f7c29773b6f8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.163881 Jul 21 22:43:53.445672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 613/1237] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:53.913613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:53.914536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:53.921403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.922077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.922618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.923072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.958552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bd5a88af-33f2-4074-a298-2222d70760b7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Jul 21 22:43:53.959120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 625/1238] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:53.969589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:53.970761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:53.978927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.979385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:53.980171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:53.980644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.014599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-07fcc43c-4d8c-40f6-bcf4-8f1e45aae169 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049302 Jul 21 22:43:54.015192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 614/1239] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:54.462674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:54.463283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:54.469412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.469862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.470606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.471036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.600856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:54.609554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6e350f82-41c0-421b-b501-182e022d0be3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150797 Jul 21 22:43:54.610146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 626/1240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:54.971313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:54.972269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:54.979990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.980599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:54.981383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:54.981817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.014210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a873f8a1-fc1f-4183-80c1-29c443bffa97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046752 Jul 21 22:43:55.014983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 615/1241] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:55.027276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:55.028257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:55.035416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.035863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.036668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.037094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.051795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:55.069363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7ff7bdc4-35fc-4842-96e6-962099337491 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046797 Jul 21 22:43:55.069939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 627/1242] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:43:55.628655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:55.629275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:55.636465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.636946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.637729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:55.638167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:55.640991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:55.782608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:55.791898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c714c0cf-4dec-4616-82d8-a6ed9bbf17e3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167937 Jul 21 22:43:55.792502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 616/1243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:56.027178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:56.028017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:56.034876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.035320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.036080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.036562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.068581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-67c37aee-866e-4461-8bef-a041ce06f6c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Jul 21 22:43:56.069155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 628/1244] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:56.155181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:56.156113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:56.162430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.162873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.163640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.164072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.195455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-49e561ff-e839-4423-b2a2-b9b64e113eb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117502 Jul 21 22:43:56.196029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 617/1245] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:56.465542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:43:56.465822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:43:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:43:56.810715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:56.811325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:56.817433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.817873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.818632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:56.819058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:56.955712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:56.963608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f2d3d5e1-d30e-4382-8e7f-02f4a05a8c66 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157799 Jul 21 22:43:56.964180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 629/1246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:57.080752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:57.081684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:57.088568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.089021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.089796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.090232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.123641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d671959-e37d-48a8-aa8d-2e8d60883b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Jul 21 22:43:57.124190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 618/1247] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:57.211872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:57.213642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:57.223272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.223726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.224533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.224978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.257649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b1aa0ed4-25df-4f35-87fd-77ed740c765c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053547 Jul 21 22:43:57.258229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 630/1248] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:57.981606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:57.982254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:57.988660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.989372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:57.990162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:57.990603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.126754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:58.134310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-47085156-4f04-43f5-90dc-4e095c138c31 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157082 Jul 21 22:43:58.134863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 619/1249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:58.136279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:58.137231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:58.143441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.143890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.144685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.145150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.174183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0741703f-712a-413f-bf8d-ab34f383579d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Jul 21 22:43:58.174733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 631/1250] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:43:58.270372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:58.271212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:58.277379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.277824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.278584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:58.279014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:58.309068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-66453de5-d3a9-4091-9bf0-fb3b51acdbb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042689 Jul 21 22:43:58.309626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 620/1251] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:43:59.151280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:59.151886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:59.158437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.158881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.159643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.160071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.186395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:59.187237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:59.194487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.194931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.195725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.196161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.227363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a893b82f-eb0f-4ddb-9488-6a7ef773af46 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Jul 21 22:43:59.228015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 621/1252] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:43:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:59.293490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:59.301125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7ce14b9b-9651-425a-8b27-4860e0a32161 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153796 Jul 21 22:43:59.301730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 632/1253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:59.321075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:59.322898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:59.329280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.329739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.330204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:59.330634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:59.361228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c08c6fbd-e5ae-4afd-ae82-ae1cfbef196b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044103 Jul 21 22:43:59.361784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 622/1254] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:43:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:00.238730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:00.239664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:00.241991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:00.248154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.248638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.249435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.249869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.278562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c7f071b1-183e-4ec8-8bec-d2c9b57fc503 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043756 Jul 21 22:44:00.279110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 633/1255] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:00.318651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:00.319254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:00.325801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.326246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.327005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.327439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.376192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:00.377281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:00.383306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.383748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.384791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:00.385122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:00.413740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6bd5335c-08ac-421c-b569-f17ca20bd999 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Jul 21 22:44:00.414425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 634/1256] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:44:00.463391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:00.470924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e10243e6-deae-4783-adbc-c969dcce6c05 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156080 Jul 21 22:44:00.471490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 623/1257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:01.289301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:01.290771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:01.297357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.297804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.298556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.298984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.328104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-65be0071-12d2-4160-a8aa-4706f42dfb8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042742 Jul 21 22:44:01.328675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 635/1258] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:01.426051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:01.426975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:01.433623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.434107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.434815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.435244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.464993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a9d2c866-3967-40ee-9dea-95342a1320f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042893 Jul 21 22:44:01.465541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 624/1259] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:01.488214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:01.488878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:01.495523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.495969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.496756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:01.497189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:01.630424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:01.638786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70b5a6ba-8a13-43df-9f59-a608df37409f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154421 Jul 21 22:44:01.639355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 636/1260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:02.339915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:02.340891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:02.346902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.347343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.348123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.348584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.378805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3b1029cc-9528-461b-8324-14eec7e93a6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Jul 21 22:44:02.379355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 625/1261] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:02.476925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:02.477874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:02.484280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.484754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.485596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.486030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.515255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5d3593cd-d110-4682-9ee4-a8a9f4615fac tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042566 Jul 21 22:44:02.515810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 637/1262] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:02.655834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:02.656378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:02.662808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.663257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.664017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:02.664449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:02.793639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:02.801236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee8e1e62-2663-4cdb-bd9a-254b13384f80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.149300 Jul 21 22:44:02.801731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 626/1263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:03.391026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:03.391947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:03.398191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.398635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.399395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.400428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.430011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0634645b-0183-478a-ae53-d7ff897f9b64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 21 22:44:03.430569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 638/1264] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:03.526722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:03.527682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:03.534044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.534493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.535247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.535707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.565143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c3979769-a752-4b45-835f-38b01d344f2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042936 Jul 21 22:44:03.565676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 627/1265] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:03.818548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:03.819183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:03.826648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.827089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.827841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:03.828273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:03.961389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:03.969092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecd950c2-40cc-481a-a822-7e0769412178 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154427 Jul 21 22:44:03.969651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 639/1266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:04.508100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:04.509202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:04.511085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=82 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:04.516598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.517047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.517856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.518290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.548234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-23b4deb9-7a7b-4dd3-93cf-7e5ad0adfcdd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111037 Jul 21 22:44:04.548820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 628/1267] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:04.577002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:04.577916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:04.583834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.584269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.585047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.585476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.614508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7ab0cdee-8b58-4f5a-b9d2-24b34f9b5f20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041429 Jul 21 22:44:04.615062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 640/1268] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:04.988015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:04.988658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:04.994878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.995421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:04.996189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:04.996654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.133425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:05.141490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d808dab1-1612-4715-b3a0-1e34df005b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158143 Jul 21 22:44:05.142050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 629/1269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:05.560600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:05.561552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:05.568196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.568680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.569435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.569865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.597989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5d3d4c6a-82f7-4e36-bd50-178cdfef076e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042012 Jul 21 22:44:05.598530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 641/1270] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:05.627082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:05.628026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:05.634557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.634997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.635755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:05.636186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:05.666983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1169a744-1bed-4c4a-9a8e-f71104245641 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043911 Jul 21 22:44:05.667586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 630/1271] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:06.159603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:06.160142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:06.166977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.167420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.168166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.168621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.300703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:06.308305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce0d06c7-aac9-4d8d-ab6e-05c5dcf1bc43 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152613 Jul 21 22:44:06.308884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 642/1272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:06.610625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:06.611550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:06.617686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.618130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.619503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.619932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.650752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-028afbe2-cabf-4589-9da0-0d9cb206586b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Jul 21 22:44:06.651468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 631/1273] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:06.678941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:06.679864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:06.687064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.687404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.688174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:06.688639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:06.718381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-14ad2696-ff7e-4a4d-9961-bf0e1a13e31c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Jul 21 22:44:06.718930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 643/1274] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:44:07.324366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:07.325003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:07.331540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.331998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.332813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.333257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.465941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:07.468131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:07.474765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0b668985-b47a-446f-9b74-0eaeed035bee tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154216 Jul 21 22:44:07.475324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 632/1275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:07.662434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:07.663354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:07.669484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.670514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.671275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.671705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.674125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:07.702856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94edb6c6-7179-438e-9edb-18e92320c611 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jul 21 22:44:07.703510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 644/1276] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:07.729875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:07.730793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:07.738011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.738696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.739163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:07.739596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:07.770182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:44:07.770444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:44:07.770872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2c184282-0234-4d9d-b35b-e52b27b4b2f8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044993 Jul 21 22:44:07.771629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 633/1277] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:08.492087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:08.492730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:08.499748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.500196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.501241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.501684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.648891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:08.657296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-49bd01e5-d931-4943-9155-165fdc63f4b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.168968 Jul 21 22:44:08.657870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 645/1278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:08.714607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:08.715601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:08.722245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.722786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.723619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.724122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.755349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-911ab69d-c398-4c00-baf4-f3702c83580e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044809 Jul 21 22:44:08.756615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 634/1279] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:08.783278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:08.784825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:08.791558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.792007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.792804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:08.793222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:08.825667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-36faf6e9-43d5-4327-acd5-4893194bc3d3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047020 Jul 21 22:44:08.826789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 646/1280] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:09.674711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:09.675329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:09.683336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.683833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.684602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.685045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.768469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:09.769440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:09.775812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.776152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.776955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.777377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.808876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b061fdb3-68f9-447f-a337-2c0ad817ccad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045190 Jul 21 22:44:09.809538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 647/1281] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:09.833276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:09.837656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:09.838570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:09.841559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee2e7f16-1429-4d05-b9bf-78ab1bea6f02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.170375 Jul 21 22:44:09.851491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 635/1282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:09.851716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.851716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.851716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:09.851716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:09.878168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d560158-dcd7-46f6-8eb3-569521184499 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Jul 21 22:44:09.878732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 648/1283] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:44:10.820802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:10.822158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:10.830622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.831075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.831848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.832277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.860183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:10.860836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:10.866267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0044ae3e-f281-47dd-8999-a91aff16d46d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049624 Jul 21 22:44:10.866829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 636/1284] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:10.868534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.869100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.869994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.870804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.890889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:10.891839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:10.898227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.898679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.899467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:10.899908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:10.935340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a09d17a0-c07b-470c-891b-4b33c75d44fd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048839 Jul 21 22:44:10.936125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 637/1285] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:44:11.016455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:11.024227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0e4ec348-feb9-4012-b659-30589c920928 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.168476 Jul 21 22:44:11.024830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 649/1286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:11.878519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:11.879474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:11.886147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:11.886588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:11.887346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:11.887777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:11.918835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ffdb8f11-d518-4a29-91c5-b114d6c12480 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Jul 21 22:44:11.919453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 638/1287] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:11.947395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:11.948324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:11.954697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:11.955152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:11.955931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:11.956362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:11.986735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6b05a22-d39c-4b74-992a-71ad3a3d7b88 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043344 Jul 21 22:44:11.987369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 650/1288] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:12.042127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:12.042817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:12.049833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:12.050276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:12.051041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:12.051472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:12.191035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:12.199399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-783801f3-98eb-47e5-bd8f-d65c6e409a80 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161169 Jul 21 22:44:12.199948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 639/1289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:12.931236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:12.932159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:12.939055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:12.939503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:12.940269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:12.940726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:12.969804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b3d2cba6-7145-4abe-8538-d381bac61aa6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042515 Jul 21 22:44:12.970418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 651/1290] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:12.999422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:13.000337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:13.007085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.007531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:13.008281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.008734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:13.037736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-412ca1db-f8be-4055-9c08-23ffdb13cda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043153 Jul 21 22:44:13.038283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 640/1291] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:13.217243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:13.217768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:13.224023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.224466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:13.225245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.225675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:13.358443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:13.366076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-638cac3c-017c-441d-9444-cd6aa05f8655 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152750 Jul 21 22:44:13.366616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 652/1292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:13.981459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:13.982383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:13.988381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.988853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:13.989606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:13.990035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:14.019915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-806992ce-2912-4fa1-b9e1-fccbb782e643 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042401 Jul 21 22:44:14.020617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 641/1293] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:14.049026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:14.049947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:14.056393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:14.056871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:14.057631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:14.058072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:14.087015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8fe2f7d4-b4f2-4f64-9a48-d25725da4d4d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042171 Jul 21 22:44:14.087549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 653/1294] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:14.385155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:14.385855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:14.393219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:14.393709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:14.394595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:14.395095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:14.540281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:14.548404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-609445af-c4e1-4628-ba4d-74805955137d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.167278 Jul 21 22:44:14.548996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 642/1295] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:15.031665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:15.032618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:15.038677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.039128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.039888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.040327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.069870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b85696c1-d704-49e4-b2e0-472b3c9d095b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Jul 21 22:44:15.070506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 654/1296] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:15.099443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:15.100414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:15.106910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.107354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.108109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.109129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.137879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-33e23717-f514-4974-8bfa-fee638eac69c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042433 Jul 21 22:44:15.138428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 643/1297] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:15.565724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:15.566333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:15.572358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.572833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.573595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:15.574028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:15.764315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:15.772587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1a7b2700-9d6d-41d5-903a-99049c9bdfd2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.210661 Jul 21 22:44:15.773144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 655/1298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:16.081341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:16.082265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:16.088395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.088874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.089627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.090056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.119129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9fcf047-e172-4a58-82ba-b98445deca05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042287 Jul 21 22:44:16.119857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 644/1299] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:16.149961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:16.150909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:16.158180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.158629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.159428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.159862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.191183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d17187bd-4e74-4356-b0ef-008b99a28339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Jul 21 22:44:16.191746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 656/1300] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:16.790246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:16.790869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:16.796930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.797371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.798144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:16.798584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:16.930752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:16.939132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-75acc8f1-79bb-498c-bb0b-89f10649cc10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152749 Jul 21 22:44:16.939696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 645/1301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:17.131009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:17.131834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:17.137804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.138356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.139110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.139538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.168601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0541afa1-1d37-4ab6-a7c1-ceaac6827fcd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041814 Jul 21 22:44:17.169219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 657/1302] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:17.203152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:17.204097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:17.210599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.211047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.211809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.212244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.242235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-87b4e395-9640-4bc5-8211-3d3cac5b4fb2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043407 Jul 21 22:44:17.242777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 646/1303] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:17.956938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:17.957545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:17.963501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.964011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:17.964727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:17.965154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.181350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:18.182337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:18.188612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.189419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.189793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.190239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.222627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2b27c374-1fb2-4e13-ba99-1630dad304b2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Jul 21 22:44:18.223256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 647/1304] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:18.244510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:18.253519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-625e69b6-c8b4-47ec-a8da-05383de1effa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.301131 Jul 21 22:44:18.254097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 658/1305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:18.257450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:18.258746 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:18.264765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.265230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.266851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:18.267293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:18.297326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1a284a70-0e74-46ca-b742-005275f4a688 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046239 Jul 21 22:44:18.297910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 648/1306] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:19.234335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:19.235475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:19.242364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.242820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.243614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.244046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.273422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:19.277173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:19.277608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ad8d3809-d533-478c-9cda-adf485615b7f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Jul 21 22:44:19.278183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 659/1307] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:19.288246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.288768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.289745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.290190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.306458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:19.309713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:19.310643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:19.317961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.318413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.319239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:19.319677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:19.346979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:19.353659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-656db667-e1b1-4f5d-b028-b0f96ec6ee0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048326 Jul 21 22:44:19.354227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 660/1308] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:44:19.440454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:19.448277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9c2cad7-6e19-4232-91e6-57e8c765bf16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.179964 Jul 21 22:44:19.448915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 649/1309] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:20.290268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:20.291176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:20.299179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.299621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.300382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.300847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.331337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0aabb6b2-7d9f-44d9-b0ee-60698b2f7a76 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044961 Jul 21 22:44:20.331896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 661/1310] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:20.364943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:20.365870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:20.373457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.373901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.375184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.376093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.411321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e5c0cf49-1e12-4091-b50f-62a910a57ec7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050527 Jul 21 22:44:20.411888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 650/1311] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:20.465697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:20.466303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:20.472939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.473361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.474129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:20.474556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:20.630830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:20.639421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b52ba027-26d9-4cc7-a002-3ee0466e4597 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.177753 Jul 21 22:44:20.639999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 662/1312] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:21.344907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:21.346023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:21.352131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.352600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.353366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.353798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.387003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-61ec6a7d-4387-4437-84b3-c338c8c248a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 Jul 21 22:44:21.387708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 651/1313] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:21.424087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:21.425051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:21.431837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.432340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.433112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.433542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.466002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b49a9a6b-1119-416d-9625-522cb35ca560 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046446 Jul 21 22:44:21.466563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 663/1314] 10.222.0.42 () {60 vars in 1342 bytes} [Thu Jul 21 22:44:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:44:21.658755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:21.659281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:21.667090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.667738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.668634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:21.669270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:21.813015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:21.821304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-117f7c15-ffbd-4464-8522-cad611ece7ef tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.166444 Jul 21 22:44:21.821881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 652/1315] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:22.399100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:22.400038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:22.406459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.406913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.407696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.408134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.443577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3388dcb4-1f35-4679-b0a7-d8a9889e5951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048470 Jul 21 22:44:22.444169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 664/1316] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:22.478546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:22.479491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:22.487236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.487688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.488511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.488946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.602707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-37095135-acf8-43b1-b057-5feaa35bd01c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action" status: 200 len: 37574 microversion: 2.20 time: 0.127930 Jul 21 22:44:22.603361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 653/1317] 10.222.0.42 () {62 vars in 1318 bytes} [Thu Jul 21 22:44:22 2022] POST /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299/action => generated 37574 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:44:22.839593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:22.840204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:22.847741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.848192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.849017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:22.849456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:22.998931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:23.007425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c8c71d5-2270-49a4-9ef5-cccf4cad89c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.172032 Jul 21 22:44:23.008020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 665/1318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:23.456384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:23.457439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:23.464940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:23.465390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:23.466173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:23.466609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:23.498758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aa56ecbc-490a-40f8-88c8-ab225a93c225 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047144 Jul 21 22:44:23.499438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 654/1319] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:24.025785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:24.026382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:24.033662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.034112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.034893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.035352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.186002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:24.194689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a7531aa3-68ea-4e23-a03e-2a800e48fdc7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.172686 Jul 21 22:44:24.195261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 666/1320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:24.510884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:24.511804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:24.518320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.518828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.519586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:24.520018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:24.549181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-32267705-7525-4978-95f3-63eb79c28f84 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042189 Jul 21 22:44:24.549643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 655/1321] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:25.213077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:25.213632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:25.220740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.221188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.221954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.222386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.357066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:25.365574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ca3553a-0c86-481d-9498-0822aad0f1b6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156439 Jul 21 22:44:25.366147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 667/1322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:25.560772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:25.561698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:25.568792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.569242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.570006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:25.570441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:25.599116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-091e83bc-b84f-48e1-a053-90d774e08e94 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jul 21 22:44:25.599664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 656/1323] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:26.383410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:26.383995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:26.390459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.391993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.392469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.392924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.534281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:26.542205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f38c124d-69d7-4cc5-a798-b7153adb3b20 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.162545 Jul 21 22:44:26.542782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 668/1324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:26.610798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:26.611736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:26.619219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.619670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.620457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:26.620922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:26.655444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c89f9f16-55fc-444d-b06a-7d6663f16d1f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048488 Jul 21 22:44:26.655944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 657/1325] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:27.559333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:27.559921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:27.567013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.567461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.568225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.568714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.667196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:27.668159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:27.675202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.675655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.676432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:27.676900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:27.700867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:27.708156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4134b01c-c938-401e-9119-a25548b30cbf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Jul 21 22:44:27.708769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 658/1326] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:27.714284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1844d094-bc7f-4859-a7d6-fbcf818ba9b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158724 Jul 21 22:44:27.715447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 669/1327] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:28.720141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:28.720854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:28.727346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:28.727798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:28.728593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:28.729032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:28.732579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:28.733189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:28.740758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:28.741205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:28.741971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:28.742407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:28.759208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e9981453-a7c9-4c21-af4b-1a2e1a6b5e00 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043743 Jul 21 22:44:28.759773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 659/1328] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:28.871129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:28.878954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-89d3947f-d2ad-4082-bcb2-47c033d73528 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150223 Jul 21 22:44:28.879502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 670/1329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:29.771062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:29.771949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:29.778488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.778950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.779724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.780165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.809510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fe615615-6433-4b62-aaff-3666d705fc51 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042520 Jul 21 22:44:29.810062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 660/1330] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:29.895812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:29.896417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:29.902939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.903383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.904142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.904603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.040885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:30.049047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-58dd04a9-5743-4235-8680-840cd1e92b84 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156518 Jul 21 22:44:30.049661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 671/1331] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:30.821805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:30.822767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:30.829904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:30.830360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.831141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:30.831578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.861597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-74e515eb-9efa-42d9-9794-9d7e6b2765ac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Jul 21 22:44:30.862232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 661/1332] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:31.065810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:31.066424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:31.068841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=78 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:31.074239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.074619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.075393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.075827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.210609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:31.218097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-87037c51-2eb5-436f-985d-cad2a1dd9f9e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156674 Jul 21 22:44:31.218657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 672/1333] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:31.873599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:31.874533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:31.881402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.881853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.882618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.883054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.913238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f9846ad-730c-400c-96c7-8a4838a69e71 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Jul 21 22:44:31.913801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 662/1334] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:32.235575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:32.236593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:32.243105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.243555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.244312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.244772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.385156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:32.393217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9e60c986-60ad-454f-a3e0-9c13f6498d5a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161636 Jul 21 22:44:32.393755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 673/1335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:32.925248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:32.926170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:32.932710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.933164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.933937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.934378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.964713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8edee465-429d-487b-8862-ca434c92219e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 Jul 21 22:44:32.965335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 663/1336] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:33.409996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:33.410628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:33.417281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.417656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.418428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.418876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.551198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:33.558615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f77104ff-712c-4a34-b470-5dc8ace4ee0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152602 Jul 21 22:44:33.559147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 674/1337] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:33.976561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:33.977517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:33.983917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.984361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.985147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.986265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.014749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fa57b153-f3c9-42a4-9d01-8ce9170b8678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Jul 21 22:44:34.015288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 664/1338] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:34.576338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:34.576977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:34.584674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.585127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.585883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.586317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.724020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:34.732324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-175049ae-5c5c-43b4-909a-23e278154b16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159693 Jul 21 22:44:34.732919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 675/1339] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:35.026661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:35.027503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:35.030061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=74 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:35.035935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.036391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.037200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.037641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.067712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7678e80-89f3-402d-b17a-92629c15c298 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Jul 21 22:44:35.068284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 665/1340] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:35.750450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:35.750994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:35.758658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.759100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.759900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.760333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.879065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:44:35.879401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 (ip 10.222.0.42) !!! Jul 21 22:44:35.896980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:35.905758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8fed01c3-6f62-49a3-9915-48029329a5a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159213 Jul 21 22:44:35.906345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 676/1341] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:36.079654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:36.080684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:36.087284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.087727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.088500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.088941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.103262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:36.120118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8636e7ee-60e0-428a-95a3-4523cf23edf0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Jul 21 22:44:36.120706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 666/1342] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:36.923520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:36.924892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:36.931722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.932165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.932962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.933399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.950128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:37.075324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:37.083853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-af6769b4-eac9-456f-a33b-95820263509f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.164303 Jul 21 22:44:37.084431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 677/1343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:37.132776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:37.133704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:37.140689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:37.141203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:37.142032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:37.142739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:37.174567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f44c422b-fc5a-444e-bcf8-1e125e256adb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Jul 21 22:44:37.175045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 667/1344] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:38.100298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:38.100937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:38.107319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.107766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.108619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.109090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.185599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:38.186533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:38.193940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.194399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.195175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.195614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.226272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ea6fd20c-c492-4286-8734-bbbbf9f71894 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Jul 21 22:44:38.226840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 668/1345] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:38.246622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:38.254395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a35b55d2-d7fc-4a17-8d2c-6d9566953ac4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.158096 Jul 21 22:44:38.254945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 678/1346] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:39.238117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:39.238951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:39.245409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:39.245854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:39.246609 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:39.247041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:39.271882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:39.272505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:39.277242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-937e84c0-1aba-42c0-8647-9f4349be1484 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043322 Jul 21 22:44:39.277823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 669/1347] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:39.279012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:39.279456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:39.280227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:39.280681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:39.410600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:39.418244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-86879b72-b3d9-40bd-abc7-335743351f99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150970 Jul 21 22:44:39.418809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 679/1348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:40.273329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:40.273851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:40.279966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.280417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.281219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.281657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.289533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:40.290562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:40.297575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.298040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.298823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.299262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.341961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-33844ac4-513d-498c-a3c7-961bc16eb648 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056407 Jul 21 22:44:40.342516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 680/1349] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:40.435186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:40.435795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:40.442638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.443080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.443847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:40.444283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:40.576896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:40.585917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0c98638c-f2c7-4ec4-888e-f0f607179c90 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154604 Jul 21 22:44:40.586476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 681/1350] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:41.353706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:41.354624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:41.361116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:41.361564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:41.362869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:41.363309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:41.394464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d045506a-6c0a-413e-8aff-933635fdf9fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Jul 21 22:44:41.395059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 682/1351] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:41.603709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:41.604227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:41.610123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:41.610563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:41.611310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:41.611738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:41.742402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:41.750123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a0f6c228-90a5-40da-a18c-58e908bf3947 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150325 Jul 21 22:44:41.750678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 683/1352] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:42.406291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:42.407203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:42.413894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:42.414244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:42.415226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:42.415725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:42.447313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6b04e330-e82b-466a-9fce-72872418e95c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Jul 21 22:44:42.447864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 684/1353] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:42.767143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:42.767687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:42.774834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:42.775286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:42.776032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:42.776459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:42.906928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:42.915090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ff0268d8-322b-4b0b-a2ce-3a112955d8a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151853 Jul 21 22:44:42.915651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 685/1354] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:43.459750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:43.460700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:43.466814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:43.467252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:43.468014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:43.468441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:43.499278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecf3df5e-7976-43e7-b44b-4d01c0ecedca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Jul 21 22:44:43.499821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 686/1355] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:43.932014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:43.932798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:43.938847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:43.939293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:43.940049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:43.940537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:44.074099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:44.082299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8ad988e1-18de-43fd-8a13-808c4aafdbf8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154126 Jul 21 22:44:44.082849 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 687/1356] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:44.511360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:44.512281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:44.518249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:44.519247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:44.520014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:44.520448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:44.548171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-54288ebd-71ff-4d67-a576-65c0ad5c9003 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040776 Jul 21 22:44:44.548747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 688/1357] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:45.098997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:45.099594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:45.106041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:45.106490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:45.107241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:45.107671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:45.237057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:45.245158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c7ccce9-9f26-45ae-9101-97ae361b503c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150575 Jul 21 22:44:45.245716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 689/1358] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:45.559738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:45.560819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:45.567724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:45.568148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:45.568960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:45.569391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:45.597947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a4eaad4d-b31a-4f98-8ff7-7fee998feecf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 Jul 21 22:44:45.598504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 690/1359] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:46.263055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:46.263559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:46.270897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:46.271248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:46.272381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:46.272532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:46.408271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:46.416899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-44df9d93-2d40-4f8a-bba3-c69dd0339f97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157778 Jul 21 22:44:46.417501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 691/1360] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:46.609597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:46.610511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:46.616819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:46.617261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:46.618019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:46.618451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:46.647980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f21be9ef-b51f-4eaf-addb-c51aa4f16219 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042340 Jul 21 22:44:46.648567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 692/1361] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:47.434070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:47.434691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:47.441263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:47.441919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:47.442691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:47.443127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:47.573736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:47.581148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-612ca1f7-716f-43ac-8e58-66b32aded8ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150986 Jul 21 22:44:47.581706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 693/1362] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:47.659296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:47.660837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:47.666877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:47.667318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:47.668067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:47.668511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:47.671989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:47.699288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-54ec23c3-fe9f-4b29-bf29-438b54bf4255 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043753 Jul 21 22:44:47.699754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 694/1363] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:44:48.598523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:48.599136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:48.605671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:48.606123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:48.606884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:48.607322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:48.744120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:48.751517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d3b2747e-4e03-45a7-9e0c-4bc0ac1587f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156915 Jul 21 22:44:48.752070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 695/1364] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:48.756873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:48.757774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:48.763409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:48.763851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:48.764625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:48.765060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:48.793496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-57dadecd-b9e5-4418-9f3a-0bfb3f3a75fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040154 Jul 21 22:44:48.794055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 696/1365] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:49.769077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:49.770250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:49.776834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:49.777286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:49.778049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:49.778484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:49.908506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:49.916048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6baf0661-780c-4e15-9d13-95998b2a6d85 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150928 Jul 21 22:44:49.917846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 697/1366] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:49.921211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:49.922126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:49.928729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:49.929177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:49.929943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:49.930374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:49.960240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-84f58a01-621d-4f65-aa27-5abeb5fffc10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042560 Jul 21 22:44:49.960819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 698/1367] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:50.278759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=11 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:50.304044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=25 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:50.936152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:50.936795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:50.943984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:50.944443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:50.945258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:50.945695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:51.096229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:51.103768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d6ffca91-7ff7-47e5-907d-fc8e910ec226 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.171993 Jul 21 22:44:51.104257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 699/1368] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:51.109562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:51.110482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:51.117464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:51.117899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:51.118662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:51.119095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:51.150896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42751439-c8d4-404b-91d1-ae51dcc96d66 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Jul 21 22:44:51.151466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 700/1369] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:52.122221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:52.122890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:52.129915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:52.130417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:52.131190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:52.131625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:52.264943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:52.272397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-529cde3f-c503-4e97-8edb-29c037cac64a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154088 Jul 21 22:44:52.272997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 701/1370] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:52.277530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:52.278435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:52.284177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:52.284654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:52.286010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:52.286635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:52.317807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-665adfb0-58d8-42b0-b9f4-e56145d1cec9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Jul 21 22:44:52.318369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 702/1371] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:53.289738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:53.290385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:53.296997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:53.297441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:53.298203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:53.298638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:53.431881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:53.439593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8633df1c-3729-4767-8a49-2ed5fc737ae4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153842 Jul 21 22:44:53.440149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 703/1372] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:53.445339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:53.446252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:53.451953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:53.452401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:53.453187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:53.453619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:53.482478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cd8d7e3e-1a83-466c-b7f7-6793b87dbd0c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041234 Jul 21 22:44:53.483025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 704/1373] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:54.457629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:54.458383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:54.465016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:54.465458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:54.466212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:54.466640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:54.599470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:54.607048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0070cb1d-6253-4889-9283-1e8f3eecb64e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153449 Jul 21 22:44:54.607600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 705/1374] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:54.613024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:54.614478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:54.620885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:54.621333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:54.622091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:54.622519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:54.654419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c28a7016-0636-48a4-9154-9fd6c29601b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Jul 21 22:44:54.654972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 706/1375] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:55.625106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:55.625734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:55.632984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:55.633426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:55.634171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:55.634596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:55.764977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:55.773238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bdc6fc46-3bb6-43d5-a394-6a6121e12ef6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152079 Jul 21 22:44:55.773796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 707/1376] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:55.778525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:55.779445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:55.785470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:55.786004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:55.786774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:55.787210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:55.815957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c611249d-363b-499a-9c2a-70b0144da356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Jul 21 22:44:55.817129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 708/1377] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:56.791242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:56.791912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:56.798471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:56.798950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:56.799713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:56.800139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:56.937266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:56.945294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce4190aa-9a50-45f6-b315-b0473a5f8374 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157898 Jul 21 22:44:56.945853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 709/1378] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:56.950446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:56.951360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:56.958218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:56.958613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:56.959406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:56.959833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:56.985474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:56.991075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6c1fe52-647d-406f-b7db-8624306fd48a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Jul 21 22:44:56.991621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 710/1379] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:57.963136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:57.963765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:57.970385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:57.970831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:57.971587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:57.972017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:58.108166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:58.116466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6e40d7f-647a-470e-b836-5224b548cae7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157316 Jul 21 22:44:58.117081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 711/1380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:58.121762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:58.122661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:58.128531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:58.129497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:58.130536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:58.130965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:58.159683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-51fb0600-1893-4032-87e9-dceb761a6d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Jul 21 22:44:58.160274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 712/1381] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:59.133620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:59.134291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:59.140273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:59.140743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:59.141513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:59.141911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:59.275942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:59.283440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c2643ad8-51db-43eb-98df-e308877611a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154334 Jul 21 22:44:59.284001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 713/1382] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:44:59.289741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:59.290655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:59.296428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:59.296901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:59.297661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:59.298096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:59.327609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-04403b9b-2e23-4289-bcb9-2fe0f0756cb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042572 Jul 21 22:44:59.328154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 714/1383] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:00.300788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:00.302264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:00.308874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:00.309316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:00.310088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:00.310544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:00.449766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:00.457294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b2c7a014-9d44-4214-8102-90ce8ce6e4e1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.160347 Jul 21 22:45:00.457870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 715/1384] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:00.462318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:00.463216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:00.469078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:00.469485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:00.470233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:00.470663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:00.500272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c62b283e-c018-49e2-a8a4-550a303c313f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 Jul 21 22:45:00.500838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 716/1385] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:01.475644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:01.476301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:01.478635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=90 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:01.483995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:01.484441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:01.485226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:01.485661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:01.615916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:01.623438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-864a048e-18ab-4002-9370-871dbb2acee3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152366 Jul 21 22:45:01.623993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 717/1386] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:01.628801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:01.629800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:01.635497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:01.635940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:01.636911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:01.637348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:01.667215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3b32cc07-3665-41e6-b9ac-f2c39a3ff6ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042162 Jul 21 22:45:01.667768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 718/1387] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:02.640839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:02.641500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:02.648713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:02.649162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:02.649940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:02.650375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:02.783958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:02.791495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-98b354ca-fb34-4b98-a476-c718c57706fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154612 Jul 21 22:45:02.792057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 719/1388] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:02.796578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:02.797491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:02.803226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:02.803668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:02.804428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:02.804885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:02.834372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c40571c5-c6b8-4f03-9869-3bb19f758719 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041288 Jul 21 22:45:02.834921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 720/1389] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:03.808559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:03.809239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:03.815717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:03.816161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:03.816996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:03.817433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:03.950479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:03.958492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7d87d7a3-530e-47e1-80c6-be02041affb0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153916 Jul 21 22:45:03.959045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 721/1390] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:03.963554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:03.964458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:03.970071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:03.970519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:03.971275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:03.971710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:04.000159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f688e129-e4e2-47ad-bd53-00c5d3b7e182 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040098 Jul 21 22:45:04.000732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 722/1391] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:04.975577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:04.976186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:04.982657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:04.983105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:04.983867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:04.984294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:05.118054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:05.125569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-11ded6db-21aa-493a-93c2-e91a6858c333 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154380 Jul 21 22:45:05.126123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 723/1392] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:05.130883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:05.131844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:05.137435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:05.137875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:05.138630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:05.139063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:05.167480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-860f829e-42a8-45e1-8425-8d0f6b99db82 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040360 Jul 21 22:45:05.168022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 724/1393] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:06.142838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:06.143506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:06.150616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:06.151068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:06.151840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:06.152268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:06.285787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:06.294602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-27c01b52-db1e-4508-94ff-7858c4a5a6cd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155655 Jul 21 22:45:06.295160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 725/1394] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:06.299705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:06.300660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:06.306994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:06.307442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:06.308207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:06.308674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:06.338537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ef63839-7150-444b-802f-352700382603 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Jul 21 22:45:06.339084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 726/1395] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:07.312660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:07.313323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:07.320088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:07.320585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:07.321349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:07.321786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:07.336303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:07.453812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:07.461826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d628af5d-99de-4d84-99ad-cf17641668aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153760 Jul 21 22:45:07.462366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 727/1396] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:07.466836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:07.467733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:07.473376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:07.473814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:07.475179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:07.475627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:07.504340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bc98d36c-7dab-4df3-8097-02e7fadbfa1c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040952 Jul 21 22:45:07.504946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 728/1397] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:08.483044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:08.484119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:08.493025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:08.493487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:08.494253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:08.494688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:08.627405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:08.635484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-17161da9-26bf-4bc5-a642-eba6da95e3d9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.159723 Jul 21 22:45:08.636053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 729/1398] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:08.640600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:08.641509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:08.647261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:08.647714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:08.648507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:08.648950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:08.678811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e93b9377-7a96-4cdc-a4d2-2ca4a67d66b4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041699 Jul 21 22:45:08.679363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 730/1399] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:09.653034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:09.653710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:09.660131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:09.660607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:09.661367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:09.661801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:09.793873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:09.801443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7623f630-466a-468e-9e26-5cc01ce49c65 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152818 Jul 21 22:45:09.802005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 731/1400] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:09.807329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:09.808245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:09.813958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:09.814407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:09.815167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:09.815606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:09.844231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-25f1631f-6eeb-4c50-8480-2ede4b9ed356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040551 Jul 21 22:45:09.844830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 732/1401] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:10.819944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:10.820608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:10.827072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:10.827524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:10.828282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:10.828743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:10.962256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:10.969859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-39565f50-fbde-45ae-9348-f397ee7e1c1b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154551 Jul 21 22:45:10.970445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 733/1402] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:10.975075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:10.975976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:10.981838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:10.982280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:10.983030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:10.983457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:11.012242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7ee38e90-94b5-4209-9bdf-9eb63c1164d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040788 Jul 21 22:45:11.012821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 734/1403] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:11.987138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:11.987812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:11.994358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:11.994808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:11.995573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:11.996005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:12.129006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:12.136708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-60a50cf0-b42d-4060-93cb-8342a0bbc490 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153476 Jul 21 22:45:12.137269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 735/1404] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:12.141820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:12.142660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:12.148896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:12.149345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:12.150102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:12.150540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:12.180670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b9af050-fc27-494c-adc2-f83809b6e744 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042349 Jul 21 22:45:12.181223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 736/1405] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:13.154214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:13.154873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:13.161350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:13.162356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:13.163131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:13.163569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:13.293029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:13.300465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96578580-24e1-4eed-b8b0-a52a7a863dfb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150164 Jul 21 22:45:13.301043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 737/1406] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:13.306443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:13.307348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:13.313244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:13.313690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:13.314521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:13.314959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:13.343923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4032ef7a-1e03-479a-8967-3d0f7d1f87da tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 Jul 21 22:45:13.344520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 738/1407] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:13.565193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 02526e73-3f8e-4ab0-a000-79f1250f9be2 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:45:14.317883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:14.319270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:14.325816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:14.326257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:14.327010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:14.327438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:14.462816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:14.470346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-85287ad2-e6c9-4b3d-af44-ce47777b60d7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156332 Jul 21 22:45:14.470900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 739/1408] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:14.475614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:14.476534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:14.482312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:14.482758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:14.483594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:14.484027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:14.513778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fdaa2452-7278-4ec9-b645-d17f91feba6e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041876 Jul 21 22:45:14.514327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 740/1409] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:15.487528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:15.488134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:15.494631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:15.495076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:15.495828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:15.496253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:15.624445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:15.633216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dac9f401-5cc6-40b2-a9f7-abafe1967ec3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.149514 Jul 21 22:45:15.633780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 741/1410] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:15.638363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:15.639273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:15.644843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:15.645293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:15.647295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:15.647751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:15.676943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52c19a6d-4545-4e39-a32b-8b4cb1a84bd9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Jul 21 22:45:15.678069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 742/1411] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:16.650654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:16.651322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:16.657838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:16.658284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:16.659045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:16.659477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:16.792789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:16.800281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-544c855e-d859-43d7-b388-7cffc3e7c30b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153561 Jul 21 22:45:16.800863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 743/1412] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:16.805416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:16.806361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:16.812081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:16.812553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:16.813315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:16.813748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:16.816058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:16.845553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3b349fe7-2edb-4bd8-9927-f4382c43e213 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Jul 21 22:45:16.846362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 744/1413] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:17.818713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:17.819401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:17.826042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:17.826488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:17.827242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:17.827671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:17.958418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:17.966728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-95d240ed-2025-4426-a05e-b879647e80c5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.153256 Jul 21 22:45:17.967306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 745/1414] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:17.971833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:17.972767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:17.978499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:17.978942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:17.979692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:17.980120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:18.009024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b89e8a80-9066-4df0-9bfa-5664bbc45c40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040709 Jul 21 22:45:18.009566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 746/1415] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:18.984084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:18.984742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:18.991242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:18.991682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:18.992466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:18.992920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:19.123017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:19.131279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-02f795bd-1ee1-462a-87ad-5187bb14ddbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151007 Jul 21 22:45:19.131830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 747/1416] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:19.136330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:19.137273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:19.143049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:19.143413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:19.144165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:19.144619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:19.173156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2f4e7985-c078-40be-b5ef-cdfeec9725a7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040326 Jul 21 22:45:19.173785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 748/1417] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:20.149634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:20.150322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:20.156727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:20.157170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:20.157921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:20.158363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:20.294804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:20.302383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2bd923bb-33cd-4f48-be4f-6b91e1f59e41 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156645 Jul 21 22:45:20.302908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 749/1418] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:20.307401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:20.308311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:20.314087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:20.314521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:20.315277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:20.315711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:20.344655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-332693fd-38fd-4220-b6d4-5ab9b1d39773 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040694 Jul 21 22:45:20.345214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 750/1419] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:21.320200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:21.320892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:21.327344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:21.327792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:21.328572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:21.329006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:21.463542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:21.471073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-62408235-af5d-4488-8227-fecc75bd7a5e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155797 Jul 21 22:45:21.471627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 751/1420] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:21.476783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:21.477834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:21.483460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:21.483897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:21.484688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:21.485115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:21.515605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6c0c540e-2c5e-4388-85e1-b0874dc9af47 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042941 Jul 21 22:45:21.516161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 752/1421] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:22.489333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:22.489967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:22.497184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:22.497628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:22.498378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:22.498809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:22.634609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:22.642143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5e10fe3-233b-478b-90e1-78e78ded2912 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156767 Jul 21 22:45:22.642688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 753/1422] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:22.647354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:22.648307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:22.654480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:22.654963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:22.655732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:22.656169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:22.686535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d2e1be17-261a-41e4-bca0-032e8fdcd5ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Jul 21 22:45:22.687086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 754/1423] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:23.569801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:23.659245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:23.659813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:23.666858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:23.667305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:23.668067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:23.668512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:23.798764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:23.806581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-68715973-38db-498c-9424-c914f70923f3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151281 Jul 21 22:45:23.807147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 755/1424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:23.811635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:23.812563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:23.818217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:23.819161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:23.819927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:23.820363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:23.848304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a618a710-9373-4eb4-b5da-52a4dedf5232 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040165 Jul 21 22:45:23.848889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 756/1425] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:24.824197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:24.824899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:24.831251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:24.831694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:24.832444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:24.832905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:24.962434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:24.970272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-540986de-7dae-4ff4-9a67-51e75ec26322 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.150007 Jul 21 22:45:24.971406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 757/1426] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:24.975625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:24.976611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:24.982739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:24.983218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:24.983981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:24.984416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:25.014076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e8ca8833-0d13-4656-96f8-7fcdb12d4230 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042233 Jul 21 22:45:25.014628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 758/1427] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:25.988257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:25.988963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:25.996760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:25.997204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:25.997961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:25.998391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:26.131213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:26.138746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1827f56d-7fd1-4c9b-a687-e0f3abf5fdcf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154385 Jul 21 22:45:26.139302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 759/1428] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:26.143825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:26.144806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:26.150694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:26.151135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:26.151887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:26.152318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:26.178881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:26.184341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-81a35ab2-829c-4f42-8ea3-b71e178efe34 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Jul 21 22:45:26.184923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 760/1429] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:27.155853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:27.156652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:27.164128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:27.164606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:27.165366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:27.165796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:27.299318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:27.307315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2a4c8c34-fec9-4f0a-9325-44dfc7364e57 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155278 Jul 21 22:45:27.307875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 761/1430] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:27.312611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:27.313441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:27.320187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:27.320668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:27.321622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:27.322216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:27.352298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bb760e91-83db-4adc-9c19-8d785fec0c91 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Jul 21 22:45:27.352893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 762/1431] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:28.326340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:28.326982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:28.333432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:28.333879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:28.334670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:28.335706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:28.468836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:28.476931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eb952bc0-7d4b-43a9-8f9c-13c552e78e50 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154527 Jul 21 22:45:28.477493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 763/1432] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:28.481996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:28.482898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:28.488785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:28.489233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:28.489997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:28.490429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:28.519161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-57396d51-5aba-49eb-a2e6-6ff43e72fb7a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040647 Jul 21 22:45:28.519713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 764/1433] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:29.494488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:29.495122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:29.501564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:29.502007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:29.502759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:29.503184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:29.635718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:29.643353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-15ad2fa5-00dc-4c6e-9424-de7c87220819 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.152810 Jul 21 22:45:29.643905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 765/1434] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:29.649084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:29.649998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:29.656124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:29.657610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:29.658422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:29.658867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:29.689781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-af5bb976-0038-4f8e-b6f6-0db3433037a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Jul 21 22:45:29.690263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 766/1435] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:30.660860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:30.661545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:30.664022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:30.669115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:30.669563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:30.670327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:30.670756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:30.807044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:30.814493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8d4f00a0-f5f4-45f2-bd13-a06388542008 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157523 Jul 21 22:45:30.815047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 767/1436] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:30.819694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:30.820627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:30.826249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:30.826692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:30.827436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:30.828023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:30.856931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4cebeac4-96fa-4585-bf1a-f6f11fcc8481 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Jul 21 22:45:30.857474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 768/1437] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:31.832221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:31.832927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:31.839583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:31.840033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:31.840828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:31.841266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:31.974902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:31.983042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a8fdf3ad-6cdb-412b-910a-96e2316b4dd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.154732 Jul 21 22:45:31.983640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 769/1438] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:31.989290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:31.990217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:31.997067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:31.997509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:31.998271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:31.998699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:32.027661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1199e6e9-5e26-4df2-8ac7-6bf68828d4f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Jul 21 22:45:32.028208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 770/1439] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:33.001422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:33.002049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:33.009534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:33.009972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:33.010723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:33.011149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:33.139215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:33.146669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-02ae880c-3d02-408a-8704-736544afd931 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.149117 Jul 21 22:45:33.147282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 771/1440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:33.151784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:33.152718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:33.158458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:33.158900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:33.159651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:33.160082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:33.188187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d0c65d0e-2e29-46a0-b987-ae6256aed061 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039920 Jul 21 22:45:33.188754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 772/1441] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:34.164780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:34.165517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:34.171960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:34.172406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:34.173188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:34.173617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:34.314301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:34.321933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9f02e6c-ee77-4bd4-b6f2-994e881db05a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.161597 Jul 21 22:45:34.322499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 773/1442] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:34.327000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:34.327908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:34.334199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:34.334643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:34.335400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:34.335836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:34.364761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-97cfc175-8abd-4707-af6c-e9bf54b3a224 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041211 Jul 21 22:45:34.365313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 774/1443] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:35.338898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:35.339579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:35.345975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:35.346422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:35.347180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:35.347615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:35.482828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:35.490380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ae38a16f-a57a-4c47-b7bf-d5282f7ee19d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.155353 Jul 21 22:45:35.491490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 775/1444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:35.496137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:35.497063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:35.502964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:35.503412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:35.504506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:35.504942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:35.533650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c68f2fb-5d84-495f-b750-61b9c00455ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Jul 21 22:45:35.534194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 776/1445] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:36.508600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:36.509254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:36.515662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:36.516107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:36.516894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:36.517330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:36.532823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:36.653919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:36.661447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-427a716e-d70e-44d2-9d34-b8c46654316a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.157556 Jul 21 22:45:36.662013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 777/1446] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:36.667141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:36.668060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:36.674351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:36.674801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:36.675578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:36.676013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:36.706575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-19251ed5-6c5c-4320-b7d2-a373ad06c122 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 Jul 21 22:45:36.707062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 778/1447] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:37.679583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:37.680250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:37.686840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:37.687224 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:37.687988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:37.688422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:37.818375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:37.826965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32a13fb7-c590-476d-8beb-b38baed874d5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151351 Jul 21 22:45:37.827521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 779/1448] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:45:37.832123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:37.833065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:37.840389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:37.840869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:37.841637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:37.842066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:37.870866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-018f6470-4c1d-42a3-a1d8-b158c162f89e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Jul 21 22:45:37.871409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 780/1449] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:38.843777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:38.844453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:38.851704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:38.852149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:38.852966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:38.853423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:38.983532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:38.991612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1d51c890-6b55-45a1-a3c8-a1a1b1e4c05e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.151192 Jul 21 22:45:38.992184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 781/1450] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:38.996702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:38.997615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:39.003216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:39.003664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:39.004715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:39.005153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:39.035030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc200aad-2a0e-41ac-85bc-e3fbdaadb497 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041802 Jul 21 22:45:39.035579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 782/1451] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:40.009081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:40.009761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:40.016389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.016868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:40.017634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.018069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:40.159210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:45:40.167684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a9a30b29-9605-48a9-b340-0dc32aadb250 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.163019 Jul 21 22:45:40.168145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 783/1452] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:45:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:45:40.172751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:40.173668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:40.179461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.179983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:40.181337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.181770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:40.210095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6cb24c0e-55bb-4bb2-9b2e-f22084cb0d0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040914 Jul 21 22:45:40.210651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 784/1453] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:45:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:45:40.333606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:45:40.334104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:45:40.340878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.341326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:40.342081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:45:40.342511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:45:43.230058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:45:43.230614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f (ip 10.222.0.42) !!! Jul 21 22:45:50.338945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=37 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:45:50.361498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=49 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:04.130352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:46:04.131116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f (ip 10.222.0.42) !!! Jul 21 22:46:40.429602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f5096566-a714-4d57-b17e-2a0f82e5d48b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f" status: 202 len: 0 microversion: 2.1 time: 120.161129 Jul 21 22:46:40.430647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 670/1454] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:44:40 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f => generated 0 bytes in 120163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:46:40.437929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.438640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:40.445049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.445495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:40.446262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.446763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:40.514604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 02526e73-3f8e-4ab0-a000-79f1250f9be2 {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:46:40.607555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:46:40.616376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb2a8ace-d201-413c-99e3-74512f1b9fbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.184399 Jul 21 22:46:40.616964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 671/1455] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:46:40.621700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.622720 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:40.630402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.630857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:40.631689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.632132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:40.663513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2aa181e-bdf8-4102-997e-74010fd5b2eb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Jul 21 22:46:40.664080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 672/1456] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 22:46:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:46:40.668703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:46:40.669199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:46:40.675560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.676014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:40.676807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:46:40.677248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:46:50.567508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:50.673680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:46:50.696668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:13.667500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Request method failure captured: Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f HTTP/1.1 Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dTkRJYQTG25lb2Tw3cQh-d2wLbUCIaXr4w4d6egkWR-_8X8mjQbk310Okz6AQJOrKCJ3bJ9F42oeIcw5PWZjJx-JHYujEad4JLtjX7IrS4F4r7UHa1YIl_p0BUPpY5vHzN9cbyqxV9NYUuc-umME4E1L_coBFt7O5e7zoiVFu38RGY Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: b8abe8948c934248a448532711d4499b Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:47:13.669834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8abe8948c934248a448532711d4499b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8abe8948c934248a448532711d4499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: b8abe8948c934248a448532711d4499b Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b6a2a022db8b4ef98a8c4932f753240a Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:47:13.671715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': '02526e73-3f8e-4ab0-a000-79f1250f9be2', 'id': 'e440c591-e7e9-4032-9a46-904ac66c9a6f'} Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:47:13.672914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:47:13.674921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:13.676378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:47:13.677668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) Jul 21 22:47:13.679067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:47:13.680379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-13b3a55f-a3bc-4a25-b9d2-8a23b1d7a109) {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:47:13.680379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2d18dbd0-fa2f-4bd3-83a7-0462af973584 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f" status: 400 len: 269 microversion: 2.1 time: 93.341780 Jul 21 22:47:13.680379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 785/1457] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:45:40 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f => generated 269 bytes in 93343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:47:13.680379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:13.680768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:13.685075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:13.685463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:13.686277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:13.686722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:13.716277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:47:13.718878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 02526e73-3f8e-4ab0-a000-79f1250f9be2 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:47:13.797468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6ab5f13f-62ed-488c-a5c7-6e486a1719b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 204 len: 0 microversion: 2.1 time: 0.124292 Jul 21 22:47:13.798500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 786/1458] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:47:13 2022] DELETE /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:47:13.872884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-b6075875-8770-421a-90a3-c8d56a15369a req-f8e98422-83ee-460a-99db-6645b58d04a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:47:13.882094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-b6075875-8770-421a-90a3-c8d56a15369a req-f8e98422-83ee-460a-99db-6645b58d04a4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:13.882530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-b6075875-8770-421a-90a3-c8d56a15369a req-f8e98422-83ee-460a-99db-6645b58d04a4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:13.894073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-b6075875-8770-421a-90a3-c8d56a15369a req-f8e98422-83ee-460a-99db-6645b58d04a4 service nova] Creating event network-changed:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:47:13.898974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-b6075875-8770-421a-90a3-c8d56a15369a req-f8e98422-83ee-460a-99db-6645b58d04a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098927 Jul 21 22:47:13.900042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 787/1459] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:47:13.904921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:47:13.906181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:13.912287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:13.912771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:13.913524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:13.913956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:14.016904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8955b117-21f1-48a8-8029-34498d6a10e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action" status: 200 len: 76235 microversion: 2.1 time: 0.115736 Jul 21 22:47:14.018540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 788/1460] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 22:47:13 2022] POST /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786/action => generated 76235 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:47:14.022907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:14.023614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:14.031170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:14.031618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:14.032421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:14.032875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:14.166809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:14.175243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-32f1b24f-a9be-4061-990a-6d23aa083f94 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1570 microversion: 2.1 time: 0.156584 Jul 21 22:47:14.175822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 789/1461] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:15.193043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:15.193709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:15.200103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:15.200587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:15.201358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:15.201795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:15.338512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:15.346752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1e548a8a-28f3-420c-90d5-55d51cfe2e9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157641 Jul 21 22:47:15.347312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 790/1462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:16.364231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:16.364944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:16.376978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:16.377427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:16.378192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:16.378629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:16.474237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:16.474759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:47:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f (ip 10.222.0.42) !!! Jul 21 22:47:16.518139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:16.525929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-00424638-0d39-49af-87a2-c45c49dccc9f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.165567 Jul 21 22:47:16.526496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 791/1463] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:17.543096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:17.543750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:17.550293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:17.550742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:17.551497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:17.551931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:17.684091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:17.695191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63e503ea-29cd-4efa-b1c9-5f1135fcb0fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153813 Jul 21 22:47:17.695191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 792/1464] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:18.710317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:18.710951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:18.717325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:18.717774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:18.719153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:18.719588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:18.851660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:18.859119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ee89b72d-8d8c-4952-ae7f-14bedd824fb8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152825 Jul 21 22:47:18.860182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 793/1465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:19.876745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:19.877424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:19.883947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:19.884389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:19.885171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:19.885599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:20.013918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:20.022925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-47dba232-87db-4e68-84d7-79412ea7cced tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150296 Jul 21 22:47:20.023491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 794/1466] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:21.107839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:21.108451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:21.115646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:21.116099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:21.116965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:21.117397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:21.251787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:21.259465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8e9897ad-776b-46e9-85f5-7b391b16233b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.222562 Jul 21 22:47:21.260027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 795/1467] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:22.277201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:22.277879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:22.284799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:22.285242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:22.285994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:22.286426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:22.418746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:22.426851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2bdcee02-6a42-41ae-861e-51e55d3d66a7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153613 Jul 21 22:47:22.427642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 796/1468] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:23.443846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:23.444530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:23.450663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:23.451110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:23.451874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:23.452310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:23.586683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:23.594742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9b596eb-2c76-4ffb-8919-e09001c66a82 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154338 Jul 21 22:47:23.595519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 797/1469] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:23.723260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:24.611925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:24.612505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:24.619061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:24.619513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:24.620278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:24.620738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:24.755703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:24.763474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-071c0052-a778-47cf-ac02-4661a0f0841f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155541 Jul 21 22:47:24.764034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 798/1470] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:47:25.781689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:25.782471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:25.788954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:25.789400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:25.790158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:25.790580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:25.923150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:25.930756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b229a16c-2380-41e7-8b59-8a7ccba241bb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153538 Jul 21 22:47:25.931322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 799/1471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:26.952666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:26.953905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:26.960735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:26.961184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:26.961927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:26.962355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:27.096683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:27.104209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ad84bec0-ce5a-434b-8cd7-c23ce09f22b5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155406 Jul 21 22:47:27.104801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 800/1472] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:27.778996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:27.779303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:47:28.121993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:28.122666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:28.129751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:28.130197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:28.131196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:28.131637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:28.269663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:28.273180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:28.278257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dd358643-8113-4ee5-9ed3-6429e9bb77f1 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.160162 Jul 21 22:47:28.278822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 801/1473] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:29.297895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:29.298564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:29.306165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:29.306610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:29.307369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:29.307802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:29.643704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:29.651295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f3350695-7408-4245-863d-4bb7e54ebc97 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.358590 Jul 21 22:47:29.651891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 802/1474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:30.668846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:30.669519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:30.676555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:30.677007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:30.677769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:30.678217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:30.806582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:30.814984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e9b93069-6cb6-4425-a493-5149fb65b757 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149988 Jul 21 22:47:30.815546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 803/1475] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:31.831282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:31.831947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:31.838587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:31.839034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:31.839802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:31.840235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:31.972927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:31.980406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cd7c2369-9298-49ce-b8ca-748211436ebd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153078 Jul 21 22:47:31.980990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 804/1476] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:32.998195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:32.998867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:33.005434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:33.005873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:33.006886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:33.007313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:33.137005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:33.145097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e001828f-422b-4dd1-bc0d-be061c1bd4f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150785 Jul 21 22:47:33.145664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 805/1477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:34.163170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:34.163869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:34.170283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:34.170726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:34.171478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:34.171913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:34.308286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:34.316410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f3409775-39b2-45c3-9efd-e0aa4ee77a95 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157099 Jul 21 22:47:34.317018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 806/1478] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:35.334545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:35.335177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:35.341464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:35.341909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:35.342675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:35.343098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:35.471838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:35.479301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-718417ef-6176-4064-8ae5-d707d5a9ed96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149817 Jul 21 22:47:35.479849 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 807/1479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:36.496239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:36.496938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:36.503925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:36.504373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:36.505156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:36.505591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:36.634368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:36.642624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e0a1e79d-2b46-4bcf-9c8b-a3a8926eaa39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149500 Jul 21 22:47:36.643310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 808/1480] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:37.660002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:37.660695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:37.667053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:37.667496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:37.668252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:37.668714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:37.805599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:37.813208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-11c6f479-4899-4fbf-b31e-476d05418973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157381 Jul 21 22:47:37.814555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 809/1481] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:38.831021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:38.831687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:38.838067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:38.838510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:38.839267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:38.839700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:38.970932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:38.978427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f36cfdf1-bdc4-4d4a-ad59-ec1f2080dd03 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152236 Jul 21 22:47:38.978974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 810/1482] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:39.995703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:39.996377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:40.003684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:40.004126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:40.004919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:40.005453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:40.138018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:47:40.146292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b3380bea-8f6c-4b6e-86c6-b88fb17909bd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154538 Jul 21 22:47:40.146854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 811/1483] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:47:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:47:40.525295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:47:40.525794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:47:40.527608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:40.534746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:40.535190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:40.535960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:47:40.536421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:47:50.542056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:50.555783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=64 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:47:55.887681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:55.888330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:47:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f (ip 10.222.0.42) !!! Jul 21 22:48:40.697307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Request method failure captured: Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f HTTP/1.1 Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dTkRJYQTG25lb2Tw3cQh-d2wLbUCIaXr4w4d6egkWR-_8X8mjQbk310Okz6AQJOrKCJ3bJ9F42oeIcw5PWZjJx-JHYujEad4JLtjX7IrS4F4r7UHa1YIl_p0BUPpY5vHzN9cbyqxV9NYUuc-umME4E1L_coBFt7O5e7zoiVFu38RGY Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: b8abe8948c934248a448532711d4499b Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:48:40.699676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8abe8948c934248a448532711d4499b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8abe8948c934248a448532711d4499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: b8abe8948c934248a448532711d4499b Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: b6a2a022db8b4ef98a8c4932f753240a Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:48:40.701445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'server_id': '02526e73-3f8e-4ab0-a000-79f1250f9be2', 'id': 'e440c591-e7e9-4032-9a46-904ac66c9a6f'} Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:48:40.702413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:48:40.703785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:40.705239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:40.706770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) Jul 21 22:48:40.708109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:48:40.710203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-85cc635a-9d91-4349-9783-85e0a9d7de32) {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:48:40.711079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-20ca28ab-75df-485d-bf77-74c3f3d96152 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f" status: 400 len: 269 microversion: 2.1 time: 120.046062 Jul 21 22:48:40.711652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 673/1484] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:46:40 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f => generated 269 bytes in 120047 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:48:40.721514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:40.722648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:40.730663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:40.731117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:40.731884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:40.732317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:40.870013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:48:40.873097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 02526e73-3f8e-4ab0-a000-79f1250f9be2 {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:48:40.879698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15b22be2-dbb9-4f2a-a194-1bc085eec902 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.166924 Jul 21 22:48:40.880273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 674/1485] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:48:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:48:40.885390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:48:40.885880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:48:40.893349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:40.893965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:40.894913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:48:40.895350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:48:50.878475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:50.892381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:48:50.920729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=10 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:03.238272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:49:03.238966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f (ip 10.222.0.42) !!! Jul 21 22:49:13.874241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Request method failure captured: Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f HTTP/1.1 Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dTkRJYQTG25lb2Tw3cQh-d2wLbUCIaXr4w4d6egkWR-_8X8mjQbk310Okz6AQJOrKCJ3bJ9F42oeIcw5PWZjJx-JHYujEad4JLtjX7IrS4F4r7UHa1YIl_p0BUPpY5vHzN9cbyqxV9NYUuc-umME4E1L_coBFt7O5e7zoiVFu38RGY Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: b8abe8948c934248a448532711d4499b Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:49:13.876579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8abe8948c934248a448532711d4499b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8abe8948c934248a448532711d4499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: b8abe8948c934248a448532711d4499b Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: b6a2a022db8b4ef98a8c4932f753240a Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:49:13.878112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': '02526e73-3f8e-4ab0-a000-79f1250f9be2', 'id': 'e440c591-e7e9-4032-9a46-904ac66c9a6f'} Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:49:13.878794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:49:13.879902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:13.882568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:49:13.883865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) Jul 21 22:49:13.885042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:49:13.886141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f432037d-182b-4b0d-bb90-a83ae6d41ff4) {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:49:13.886141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-95a2eda8-a00e-4104-9a03-800eb4af9aeb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f" status: 400 len: 269 microversion: 2.1 time: 93.427635 Jul 21 22:49:13.886141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 812/1486] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:47:40 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f => generated 269 bytes in 93429 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:49:13.886141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:13.886458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:13.892687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:13.893257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:13.894288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:13.894829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:14.037910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:14.045548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7986cec8-8e83-4b8d-997a-3a863d4e5df8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.165212 Jul 21 22:49:14.046101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 813/1487] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:14.066900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lazy-loading 'services' on Instance uuid 02526e73-3f8e-4ab0-a000-79f1250f9be2 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:49:14.432316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Request method failure captured: Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f HTTP/1.1 Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dTkRJYQTG25lb2Tw3cQh-d2wLbUCIaXr4w4d6egkWR-_8X8mjQbk310Okz6AQJOrKCJ3bJ9F42oeIcw5PWZjJx-JHYujEad4JLtjX7IrS4F4r7UHa1YIl_p0BUPpY5vHzN9cbyqxV9NYUuc-umME4E1L_coBFt7O5e7zoiVFu38RGY Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: b8abe8948c934248a448532711d4499b Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:49:14.432821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8abe8948c934248a448532711d4499b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8abe8948c934248a448532711d4499b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8abe8948c934248a448532711d4499b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: b8abe8948c934248a448532711d4499b Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598834229 Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: b6a2a022db8b4ef98a8c4932f753240a Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesSnapshotTestJSON-598834229-project Jul 21 22:49:14.434173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'server_id': '02526e73-3f8e-4ab0-a000-79f1250f9be2', 'id': 'e440c591-e7e9-4032-9a46-904ac66c9a6f'} Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:49:14.435336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:49:14.436384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:14.437602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:49:14.438667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) Jul 21 22:49:14.439926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:49:14.441278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc4a4eb7-888d-4856-a893-c9cff24348a3) {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:49:14.441278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c24b91af-7139-43cc-91af-10033e83129d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f" status: 400 len: 269 microversion: 2.1 time: 33.553039 Jul 21 22:49:14.441278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 675/1488] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 22:48:40 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2/os-volume_attachments/e440c591-e7e9-4032-9a46-904ac66c9a6f => generated 269 bytes in 33554 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:49:15.063604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:15.064218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:15.071520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:15.071968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:15.072748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:15.073186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:15.215290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:15.222745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab0c1820-58af-428e-bfa7-759e3771ec75 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.163022 Jul 21 22:49:15.223303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 814/1489] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:16.240353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:16.241517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:16.248240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:16.248725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:16.249499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:16.249943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:16.385216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:16.393015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c21f7a77-6ade-4a68-b267-c923de3cd0d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157254 Jul 21 22:49:16.393573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 676/1490] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:17.411993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:17.412586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:17.419883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:17.420324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:17.421121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:17.421553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:17.647426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:17.654906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5cb9dcd-be1a-43ab-af9f-75c62bcea905 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.248101 Jul 21 22:49:17.655484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 815/1491] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:18.672040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:18.672701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:18.679815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:18.680258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:18.681043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:18.681479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:18.820061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:18.827856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f0c0cd5b-b260-420e-86dd-229282911775 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.159727 Jul 21 22:49:18.828428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 677/1492] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:19.844585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:19.845202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:19.851713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:19.852160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:19.852965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:19.853401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:19.982901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:19.990430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-66042261-bcd0-4ead-86b0-f95dcec9670f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149812 Jul 21 22:49:19.992172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 816/1493] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:21.008878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:21.009471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:21.015868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:21.016289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:21.017082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:21.017510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:21.150404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:21.158200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fafaac76-b99f-4e41-a935-d5fd97cb8b7d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154102 Jul 21 22:49:21.158758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 678/1494] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:22.175649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:22.176262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:22.183352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:22.183798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:22.184582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:22.185019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:22.318110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:22.326381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94cb78bc-acca-456a-90fc-de7d4e36d4b8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154701 Jul 21 22:49:22.326946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 817/1495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:23.343641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:23.344260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:23.350437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:23.350937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:23.351705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:23.352143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:23.485096 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:23.493103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8b1b6695-3ed2-4b76-9ec6-e26b1e873c4e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153471 Jul 21 22:49:23.493670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 679/1496] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:23.762316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:49:23.762526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:49:24.509557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:24.510163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:24.516554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:24.516999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:24.517748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:24.518174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:24.647084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:24.655715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6c0378b2-35ab-4228-b570-5d867caa1dcc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150266 Jul 21 22:49:24.656289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 818/1497] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:25.674903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:25.675513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:25.682629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:25.683077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:25.683898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:25.684309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:25.820148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:25.827862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a27c4e21-538e-4ec2-abf6-596613f1de0b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156876 Jul 21 22:49:25.828437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 680/1498] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:26.845447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:26.846173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:26.852645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:26.853087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:26.853850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:26.854274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:26.986074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:26.994248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0e8128d5-48dd-4330-b870-61f0a5d0470f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152675 Jul 21 22:49:26.994807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 819/1499] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:28.011212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:28.011798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:28.018475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:28.018920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:28.019677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:28.020107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:28.154228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:28.161880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d1dc658-48e9-4900-ac28-0a9a4b545ca7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155458 Jul 21 22:49:28.162438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 681/1500] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:29.180547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:29.181185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:29.187728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:29.188174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:29.188964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:29.189395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:29.322511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:29.330209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ee7b4ca-d17d-4e06-8a9b-7d1ed3d1d51f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154045 Jul 21 22:49:29.330827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 820/1501] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:30.347836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:30.348508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:30.355483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:30.355934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:30.356733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:30.357172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:30.499558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:30.508031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b1af5886-5fcf-4f6d-80c6-782aa4001932 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.163075 Jul 21 22:49:30.508603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 682/1502] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:31.524554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:31.525271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:31.531554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:31.531992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:31.532769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:31.533196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:31.667974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:31.675487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5f4b4f3-c3a1-4a17-af95-836470739477 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155446 Jul 21 22:49:31.676048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 821/1503] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:32.692470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:32.693062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:32.700283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:32.700837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:32.701601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:32.702032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:32.833158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:32.840957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0ebceddc-e5ff-4695-b278-0fc74c4af70c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152477 Jul 21 22:49:32.841520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 683/1504] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:33.857868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:33.858493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:33.865011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:33.865448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:33.866228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:33.866653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:33.998134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:34.005612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-edff125f-f5cc-4ebe-b0b2-65eabde594aa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.151590 Jul 21 22:49:34.006169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 822/1505] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:35.023255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:35.023856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:35.031599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:35.032050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:35.032922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:35.033362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:35.182256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:35.189759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d7cb33d1-4c2d-44f0-a498-d41ba206ee22 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.170407 Jul 21 22:49:35.190329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 684/1506] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:36.207358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:36.207970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:36.214576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:36.215017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:36.215770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:36.216197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:36.347620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:36.355910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ffded5f7-8b97-4113-8229-0240d586df7e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152360 Jul 21 22:49:36.356506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 823/1507] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:37.373210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:37.373771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:37.380250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:37.380727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:37.382206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:37.382987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:37.518660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:37.526329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fdbc43b5-3a46-4cde-8aee-14f9ac85ad2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157043 Jul 21 22:49:37.526897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 685/1508] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:38.543940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:38.544579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:38.551019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:38.551567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:38.552338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:38.552803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:38.688344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:38.696147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2bbe3678-2c07-4fdf-9477-e309594e3dc5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156076 Jul 21 22:49:38.696746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 824/1509] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:39.714401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:39.714945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:39.721594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:39.722041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:39.722795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:39.723225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:39.857849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:39.865538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f3d46dd4-2eda-408b-9001-6311b0b9fcd7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155084 Jul 21 22:49:39.866697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 686/1510] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:40.883921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:40.884538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:40.886880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=25 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:40.892232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:40.892713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:40.893480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:40.893918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:40.896660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=73 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:41.027326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:41.034808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7c576418-89f9-4f76-88b9-afff88c9af1a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155805 Jul 21 22:49:41.035353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 825/1511] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:42.053736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:42.054547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:42.056865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=23 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:42.062591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:42.063043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:42.063817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:42.064255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:42.066967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=71 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:49:42.201443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:42.208929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-84e5a277-f958-47cd-a82b-082d40b910e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.160329 Jul 21 22:49:42.210107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 687/1512] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:43.226618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:43.227179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:43.233271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:43.233717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:43.234467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:43.234891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:43.367662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:43.375124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-341e1fe1-8b30-4a9b-8b29-fe381fcfd78e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153129 Jul 21 22:49:43.375711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 826/1513] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:44.392179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:44.392925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:44.399427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:44.399880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:44.400706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:44.401141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:44.533690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:44.541347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9dbc14a2-3221-431f-8b0d-4b73e176b7a3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153174 Jul 21 22:49:44.541912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 688/1514] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:45.558655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:45.559271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:45.565894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:45.566345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:45.567104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:45.567538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:45.697786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:45.705365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-917dd301-1b45-47a6-bc6f-0ca15ec705cb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150816 Jul 21 22:49:45.705932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 827/1515] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:46.722912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:46.723460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:46.730008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:46.730461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:46.731230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:46.731666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:46.864731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:46.873208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dd72c104-a7ad-45f9-8960-ab2f147012f0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154303 Jul 21 22:49:46.873775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 689/1516] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:47.891066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:47.891682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:47.898536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:47.898986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:47.899755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:47.900231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:48.033947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:48.041700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a9d20cc6-4873-4c75-8781-f81d6ee8f829 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154504 Jul 21 22:49:48.042267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 828/1517] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:49.059821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:49.060424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:49.067018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:49.067403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:49.068159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:49.068630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:49.203336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:49.211632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86cd0685-d834-4e3d-ac7c-598ff700ab10 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155980 Jul 21 22:49:49.212194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 690/1518] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:50.229933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:50.230532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:50.237012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:50.237456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:50.238255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:50.238682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:50.376662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:50.384635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-85f72b8f-8a46-49de-b528-2d0abf5bfcad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.159967 Jul 21 22:49:50.385196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 829/1519] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:51.401457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:51.402053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:51.408756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:51.409226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:51.409983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:51.410414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:51.542222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:51.549778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-10a783d0-4c98-421c-a5f3-e05f5a1e1e42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152231 Jul 21 22:49:51.550369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 691/1520] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:52.567496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:52.568108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:52.575300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:52.575742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:52.576546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:52.576996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:52.705355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:52.713655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4ccd01d1-97ea-4a4e-b579-050149aa1a0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150092 Jul 21 22:49:52.714206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 830/1521] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:53.731118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:53.731663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:53.737796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:53.738235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:53.739015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:53.739443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:53.872088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:53.879524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-706452b3-3ba0-4582-bd1f-703bc86eb370 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152369 Jul 21 22:49:53.880083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 692/1522] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:49:54.897031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:54.897607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:54.904933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:54.905379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:54.906130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:54.906555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:55.041607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:55.049219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08dc05cf-f26b-41ec-a29f-386accd9307a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156074 Jul 21 22:49:55.049782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 831/1523] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:56.067368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:56.067966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:56.075398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:56.075870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:56.076673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:56.077108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:56.209265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:56.218004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2dd1f6b-f11f-4b99-8426-0ec366ea0539 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154525 Jul 21 22:49:56.218592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 693/1524] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:57.235996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:57.236635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:57.243787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:57.244232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:57.245013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:57.245451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:57.374747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:57.382982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-80c6927e-9f34-427a-95f1-78c0106ef6d0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150493 Jul 21 22:49:57.383546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 832/1525] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:58.399272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:58.399901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:58.406551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:58.406990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:58.407745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:58.408173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:58.544717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:58.551956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb9b1a29-51da-465b-a01c-14fb9b787812 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156584 Jul 21 22:49:58.552529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 694/1526] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:49:59.569555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:49:59.570727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:49:59.577181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:59.577641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:59.578375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:49:59.578804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:49:59.713843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:49:59.721428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fa2b37e2-5584-41e1-844b-6ade97caa2c2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155800 Jul 21 22:49:59.721988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 833/1527] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:49:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:00.739251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:00.739790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:00.746384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:00.746830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:00.747656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:00.748093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:00.880758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:00.889092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-177a9c46-c681-4eac-b408-15bd749b0638 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153893 Jul 21 22:50:00.889655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 695/1528] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:01.906387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:01.907001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:01.913436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:01.914682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:01.915556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:01.915991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:02.051611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:02.059567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aa62442b-e80b-4808-90d3-1708a441d23d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156949 Jul 21 22:50:02.060251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 834/1529] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:03.077027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:03.078152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:03.089751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:03.090324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:03.091305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:03.091747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:03.224955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:03.233507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-489794ab-c64b-4a4d-9869-6500885a599a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.160834 Jul 21 22:50:03.234074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 696/1530] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:04.251168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:04.251756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:04.259055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:04.259494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:04.260245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:04.260711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:04.408803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:04.416548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ea90cbb1-e5db-4dc4-8735-80f702728f93 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.169181 Jul 21 22:50:04.418751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 835/1531] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:05.434914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:05.435561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:05.442167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:05.442621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:05.443385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:05.443822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:05.578015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:05.586215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f81e1d02-9d17-424a-ab95-a1623c3d4a12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154643 Jul 21 22:50:05.586556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 697/1532] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:06.603710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:06.604320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:06.610882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:06.611336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:06.612155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:06.612568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:06.748825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:06.756165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5e5d1f69-89f3-4bc2-a5c8-ad121f8dc39d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157198 Jul 21 22:50:06.756754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 836/1533] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:07.774069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:07.774648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:07.781252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:07.781702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:07.782451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:07.782885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:07.912338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:07.920558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ac325ffb-18f0-494a-b3c4-2f614ee69a67 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150468 Jul 21 22:50:07.921113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 698/1534] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:08.937400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:08.938008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:08.944526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:08.945792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:08.946265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:08.946698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:09.075124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:09.082615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-641cda84-f8c7-43a8-8eca-ab0c2c653f17 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149093 Jul 21 22:50:09.083167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 837/1535] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:10.100557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:10.101493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:10.108210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:10.108696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:10.109502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:10.109953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:10.247325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:10.254828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4035059b-41e1-4865-80c5-f2c80f81f3f7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.158939 Jul 21 22:50:10.255390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 699/1536] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:11.272447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:11.273247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:11.275757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=26 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:11.280994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:11.281439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:11.282234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:11.282665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:11.285471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=78 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:11.423068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:11.431715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-930a4667-0f17-4f86-a5f2-94b74af3fbae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.163062 Jul 21 22:50:11.432299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 838/1537] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:12.450190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:12.450818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:12.453162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=26 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:12.458710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:12.459163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:12.459934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:12.460377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:12.463135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=78 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:12.591295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:12.598710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-325ac52e-a6a3-46fe-a1e4-ed7937931eea tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152432 Jul 21 22:50:12.599273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 700/1538] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:13.615781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:13.616384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:13.623372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:13.623814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:13.624601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:13.625034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:13.756013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:13.764002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a8467dde-53d6-4520-add0-476f2870fd42 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152274 Jul 21 22:50:13.764794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 839/1539] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:14.781292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:14.781832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:14.788339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:14.788819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:14.789599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:14.790034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:14.925201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:14.933931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-abd984cf-d5c8-4085-b13f-4998ae6e1686 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156667 Jul 21 22:50:14.934497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 701/1540] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:15.951645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:15.952258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:15.958852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:15.959306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:15.960075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:15.961138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:16.094201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:16.101732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e7d9c473-bff8-4989-95d3-7ee0bb6ea7d3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154029 Jul 21 22:50:16.102296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 840/1541] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:17.118804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:17.119411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:17.125938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:17.126389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:17.127149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:17.127584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:17.263595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:17.271105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-533cee41-6c42-4531-a5ad-3af245bba125 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156359 Jul 21 22:50:17.271669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 702/1542] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:18.288816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:18.289419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:18.295858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:18.296346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:18.297126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:18.297556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:18.433245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:18.440739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b842c1bd-b1d4-4987-ae35-0a503fbe666f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156041 Jul 21 22:50:18.441293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 841/1543] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:19.458745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:19.459363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:19.466058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:19.466513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:19.467282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:19.467721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:19.596659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:19.605227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b747047c-c1a4-4b5d-ac0d-f781769250db tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150573 Jul 21 22:50:19.605794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 703/1544] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:20.622374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:20.622986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:20.629794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:20.630235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:20.630988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:20.631417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:20.765113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:20.772672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5af8ad4a-1ae7-47ed-82b7-0d1513f311ec tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154198 Jul 21 22:50:20.773408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 842/1545] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:21.789892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:21.790500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:21.796787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:21.797235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:21.797995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:21.798429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:21.935807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:21.943469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-313c061c-92f9-48a2-9a6d-2c1284b43acc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157534 Jul 21 22:50:21.944030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 704/1546] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:22.961384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:22.961996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:22.968581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:22.969033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:22.969796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:22.970233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:23.116463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:23.123951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-65a25240-2d64-42c7-9bb3-160f81c02876 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.166981 Jul 21 22:50:23.124539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 843/1547] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:24.141394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:24.142031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:24.148563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:24.149016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:24.149769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:24.150199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:24.279819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:24.287460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-099deee3-1c27-4a25-ae3b-787c581d32fc tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.149987 Jul 21 22:50:24.288030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 705/1548] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:25.305519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:25.306162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:25.312754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:25.313195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:25.313943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:25.314369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:25.448063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:25.455679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6220d15a-f78d-481e-8859-6ce48f09176c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154595 Jul 21 22:50:25.456240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 844/1549] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:26.472635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:26.473254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:26.479875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:26.480324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:26.481136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:26.481578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:26.614459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:26.622741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0110d650-367d-4b78-af9e-703cb86de005 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154016 Jul 21 22:50:26.623298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 706/1550] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:27.640032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:27.640678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:27.647177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:27.647629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:27.648394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:27.648889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:27.787875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:27.796045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce4cbc78-bc7f-4c77-92be-8ad802d7cd54 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.159883 Jul 21 22:50:27.796748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 845/1551] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:28.813108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:28.813726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:28.820196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:28.820697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:28.821647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:28.822247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:28.952156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:28.959734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5a307b5e-de21-4223-96f1-e3e49d773194 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.150515 Jul 21 22:50:28.960294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 707/1552] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:29.978530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:29.979144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:29.985632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:29.986080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:29.986868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:29.987304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:30.120066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:30.128263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-624637e0-8858-4cc5-99b9-715ee5ad04fb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.154228 Jul 21 22:50:30.128866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 846/1553] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:31.144936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:31.145548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:31.152921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:31.153366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:31.154126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:31.154554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:31.290072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:31.298633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7474d5d-219a-4cb2-a1c0-5d51481ec57c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157589 Jul 21 22:50:31.299195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 708/1554] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:32.315174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:32.315872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:32.323437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:32.323889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:32.324694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:32.325133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:32.459297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:32.466808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5282c0e-f303-4d6e-88c6-41af2570d913 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.155553 Jul 21 22:50:32.467366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 847/1555] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:33.483512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:33.484125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:33.490750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:33.491203 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:33.491971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:33.492408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:33.623988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:33.631631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a5dd1853-fded-419d-afc5-febdbc9950af tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.152050 Jul 21 22:50:33.632186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 709/1556] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:34.648969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:34.649580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:34.658503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:34.658953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:34.659724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:34.660159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:34.800576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:34.808752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b87a40f-554c-47b5-9b70-4b672c232779 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.163579 Jul 21 22:50:34.809377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 848/1557] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:35.827109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:35.827724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:35.834239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:35.834691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:35.835458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:35.835894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:35.967710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:35.975336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d6acf43-4ef7-41f2-a89c-87183f99b9b9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.153245 Jul 21 22:50:35.976109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 710/1558] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:36.489340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:50:36.489592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:50:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:50:36.993196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:36.994788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:37.000861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:37.001300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:37.002056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:37.002479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:37.137996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:37.146184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0f644a92-5cab-4d2b-ac38-8f7de4c917c8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156620 Jul 21 22:50:37.146905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 849/1559] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:38.164235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:38.164861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:38.171477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:38.171922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:38.172742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:38.173176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:38.310726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:38.318165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d09997aa-41d9-4191-a1b8-f117a5224515 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.157762 Jul 21 22:50:38.318730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 711/1560] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:39.335535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:39.336142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:39.343353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:39.343804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:39.344634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:39.345128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:39.480793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:39.488332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c00bbc09-6379-483c-83ca-7e8315a659a0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.156683 Jul 21 22:50:39.488923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 850/1561] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:40.505566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:40.506178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:40.513683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:40.514137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:40.514896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:40.515331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:40.644071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:40.652863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cf9323aa-6f03-4060-99c0-bacb68a7d3ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1451 microversion: 2.1 time: 0.151096 Jul 21 22:50:40.653429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 712/1562] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:41.505888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:41.506432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:41.510923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=26 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:41.515123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.515846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.516856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.517484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.523016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=78 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:41.546168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:50:41.624277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-26b09384-dc63-4e0b-ad9f-3f8e22be686b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 204 len: 0 microversion: 2.20 time: 0.122041 Jul 21 22:50:41.624887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 851/1563] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 22:50:41 2022] DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:50:41.633401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:41.634056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:41.641081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.641534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.642307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.642747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.670940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:41.671663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:41.677728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.678171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.678938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:41.679364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:41.779679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:41.788312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:41.789859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:41.791138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aef927b6-8ea2-4f97-8d76-415ade3dbb32 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1802 microversion: 2.20 time: 0.161935 Jul 21 22:50:41.791819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 713/1564] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:41.820383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:41.829424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f7be1026-5739-4147-849e-604a28a2378c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1445 microversion: 2.1 time: 0.163875 Jul 21 22:50:41.830006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 852/1565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:42.234276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-06b0c5bc-d7b2-45ba-8efb-a320f3b2d1d0 req-682311c7-b1f3-46d1-8477-3dfcea8ae0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9", "name": "network-vif-deleted", "tag": "4a93698c-2d62-4829-a6fa-0a01963e82cd"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:50:42.242715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-06b0c5bc-d7b2-45ba-8efb-a320f3b2d1d0 req-682311c7-b1f3-46d1-8477-3dfcea8ae0e4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:42.243168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-06b0c5bc-d7b2-45ba-8efb-a320f3b2d1d0 req-682311c7-b1f3-46d1-8477-3dfcea8ae0e4 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:42.256202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-06b0c5bc-d7b2-45ba-8efb-a320f3b2d1d0 req-682311c7-b1f3-46d1-8477-3dfcea8ae0e4 service nova] Creating event network-vif-deleted:4a93698c-2d62-4829-a6fa-0a01963e82cd for instance 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 on hv-cinder-85069 Jul 21 22:50:42.264157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-06b0c5bc-d7b2-45ba-8efb-a320f3b2d1d0 req-682311c7-b1f3-46d1-8477-3dfcea8ae0e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Jul 21 22:50:42.265112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 714/1566] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:50:42.809864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:42.810475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:42.817031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:42.817473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:42.818287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:42.818721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:42.847555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:42.848351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:42.850749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=30 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:42.857656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:42.858455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:42.859305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:42.859942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:42.864511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=86 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:42.952576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:42.961111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:42.963596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:42.964611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc66c41b-9b4a-4210-85ff-be318d5f4a2b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1802 microversion: 2.20 time: 0.158757 Jul 21 22:50:42.965178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 853/1567] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:42.983214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:42.990644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2fc36275-4c20-4cbb-b6f0-0e1cfc8cf57e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.147776 Jul 21 22:50:42.991208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 715/1568] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:43.983239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:43.984521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:43.992108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:43.992602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:43.993374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:43.994198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:44.009977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:44.010842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:44.021431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:44.022242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:44.023275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:44.023937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:44.067011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:44.080246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:44.082473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:44.083947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-80854869-ecca-4cdb-a405-75976271c064 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.104711 Jul 21 22:50:44.084965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 854/1569] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:44.108353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:44.117430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2123751d-99f1-4299-87aa-3045b999f8e4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.112813 Jul 21 22:50:44.118035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 716/1570] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:44.280277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-1acf80b1-5424-4cb6-9da6-439158ce0bcf req-f0971342-6915-4237-9695-6b5aeaae680b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba1ec2e-bdda-4057-8958-97def6b80299", "name": "network-vif-deleted", "tag": "d73070aa-5b46-44d0-a1fb-d5ab883105d6"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:50:44.288757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-1acf80b1-5424-4cb6-9da6-439158ce0bcf req-f0971342-6915-4237-9695-6b5aeaae680b service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:44.289203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-1acf80b1-5424-4cb6-9da6-439158ce0bcf req-f0971342-6915-4237-9695-6b5aeaae680b service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:44.302638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-1acf80b1-5424-4cb6-9da6-439158ce0bcf req-f0971342-6915-4237-9695-6b5aeaae680b service nova] Creating event network-vif-deleted:d73070aa-5b46-44d0-a1fb-d5ab883105d6 for instance eba1ec2e-bdda-4057-8958-97def6b80299 on hv-cinder-85069 Jul 21 22:50:44.308557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-1acf80b1-5424-4cb6-9da6-439158ce0bcf req-f0971342-6915-4237-9695-6b5aeaae680b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032394 Jul 21 22:50:44.312307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 855/1571] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:50:45.102622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:45.103866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:45.110328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:45.110771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:45.111531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:45.111970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:45.136529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:45.137425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:45.143664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:45.144182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:45.145042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:45.145544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:45.183186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:45.193240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:45.194777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:45.196100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef0e94ef-3c62-497a-80c5-e91ac10e3b8a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.097409 Jul 21 22:50:45.206992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 717/1572] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:45.210238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:45.218625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-76b17d55-1969-4636-b8f8-b0f47f1a6fae tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087095 Jul 21 22:50:45.223183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 856/1573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:46.214622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:46.215222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:46.221792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:46.222243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:46.223000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:46.223429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:46.235132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:46.235857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:46.242178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:46.242622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:46.243865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:46.244296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:46.286885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:46.295707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:46.297284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:46.298443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-41664c3f-8baf-499e-9047-d08210b0f47e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087689 Jul 21 22:50:46.298994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 718/1574] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:46.307605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:46.315353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cf989878-54a8-48f7-b980-777830e9e59b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084084 Jul 21 22:50:46.315939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 857/1575] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:47.318727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:47.319331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:47.326833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:47.327279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:47.328043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:47.328492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:47.332099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:47.332738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:47.340422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:47.340919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:47.341710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:47.342152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:47.391109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:47.400273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:47.402402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:47.403583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-081e4be1-f8f3-442b-89c4-f638461f223b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088836 Jul 21 22:50:47.404136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 719/1576] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:47.404267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:47.412820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a99c4fde-66f4-480d-9524-610259f756f6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084371 Jul 21 22:50:47.413816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 858/1577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:47.788182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:50:47.788410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:50:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:50:48.421979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:48.422584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:48.429318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:48.429767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:48.430067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:48.430566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:48.431489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:48.431857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:48.438610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:48.439063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:48.439860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:48.440295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:48.495087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:48.503856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:48.505403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:48.506023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:48.506663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b0a17b64-7421-4195-a571-3b1d99d95917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088643 Jul 21 22:50:48.507215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 720/1578] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:48.514989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-95d99583-5b16-45d3-8b9d-34fad3d35261 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.088981 Jul 21 22:50:48.515570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 859/1579] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:50:49.527024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:49.527653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:49.531293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:49.531908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:49.534250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:49.534709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:49.535486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:49.535926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:49.538196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:49.538640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:49.539393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:49.539834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:49.600603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:49.602315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:49.608298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cba94c31-5e5d-489a-ab55-1945e309afcd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.080675 Jul 21 22:50:49.611811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:49.612636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 860/1580] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:49.613433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:49.614587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d8987bee-49fb-4bb0-b1cc-03add959e3f0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092095 Jul 21 22:50:49.615134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 721/1581] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:50.624930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:50.625542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:50.632075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:50.632545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:50.632738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:50.633570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:50.633676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:50.634364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:50.640129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:50.640615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:50.641373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:50.641802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:50.698680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:50.704105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:50.706486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-28bcaa42-511d-439f-bc90-fae9f4b8be96 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085506 Jul 21 22:50:50.707064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 861/1582] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:50.713458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:50.715071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:50.716289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9463309e-53bd-4aaa-ad96-bdaa1c27f5a8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087406 Jul 21 22:50:50.716941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 722/1583] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:51.724163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:51.724854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:51.731890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:51.732502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:51.733273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:51.733770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:51.734957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:51.735565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:51.741546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:51.742032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:51.742791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:51.743221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:51.797512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:51.805090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f53e2c1a-5497-4cd0-a23d-a9f7514c72c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084912 Jul 21 22:50:51.805662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 862/1584] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:51.810855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:51.819257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:51.820785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:51.822030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-576f0fec-907b-4997-9157-36fa527aba49 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091280 Jul 21 22:50:51.822558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 723/1585] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:52.823354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:52.823918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:52.830369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:52.830812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:52.831577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:52.832008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:52.839612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:52.840327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:52.847139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:52.847919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:52.848800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:52.849462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:52.897667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:52.905666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ba76a51b-79c5-4875-9f32-0c4e96076748 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086873 Jul 21 22:50:52.906252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 863/1586] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:52.947242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:52.955907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:52.957635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:52.958789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-34702382-a22e-4f98-9db5-69c25dc7cc5f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.123558 Jul 21 22:50:52.959339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 724/1587] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:53.922281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:53.922865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:53.929293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:53.929735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:53.930486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:53.931008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:53.976794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:53.977535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:53.984528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:53.984873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:53.985668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:53.986120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:53.998334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:54.006058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-879ed7c9-a47e-44be-bdad-bc996e7f480e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087571 Jul 21 22:50:54.006633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 864/1588] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:54.055460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:54.064494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:54.066024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:54.067247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0dcb8827-e625-4bde-8b4e-c12ee20f1f10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094316 Jul 21 22:50:54.067732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 725/1589] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:55.023687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:55.024244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:55.031432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:55.031880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:55.032686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:55.033126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:55.086160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:55.086764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:55.093984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:55.094219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:55.094434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:55.095197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:55.095630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:55.101851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ea33515d-24aa-4bf1-b767-335849bbd16c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082154 Jul 21 22:50:55.102424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 865/1590] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:55.157596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:55.166678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:55.168192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:55.169349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ada3b635-d8b7-4903-829b-020ed9d59ea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087126 Jul 21 22:50:55.169934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 726/1591] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:50:56.120658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:56.121303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:56.127816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:56.128263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:56.129054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:56.129501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:56.187975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:56.188723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:56.191218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:56.193406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:50:56.195461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:56.195943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:56.197396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:56.197843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:56.200213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-423bc003-9cb3-405c-bacd-b50f37f4d973 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084181 Jul 21 22:50:56.200838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 866/1592] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:56.261458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:56.269816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:56.271340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:56.272522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4524e643-a15d-483a-a563-988bdcc9ffec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088483 Jul 21 22:50:56.273073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 727/1593] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:57.219315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:57.219917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:57.227163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:57.227629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:57.228384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:57.228840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:57.290027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:57.290766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:57.293550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:57.298158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:57.298607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:57.299378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:57.299810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:57.301069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e3259bd3-40ea-4e44-92f7-0df25146ab61 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085918 Jul 21 22:50:57.301930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 867/1594] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:57.362982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:57.372083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:57.373653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:57.374849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-629d720d-b3c0-4346-81de-41d9ae067aa3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088741 Jul 21 22:50:57.375405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 728/1595] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:58.319382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:58.319995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:58.328137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:58.328624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:58.329435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:58.329874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:58.393916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:58.394526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:58.394752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:58.401465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:58.402035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:58.402686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:58.402945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-28a1eac3-25e4-4daf-ad20-e8cc533ef74c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087825 Jul 21 22:50:58.403117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:58.403526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 868/1596] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:58.481892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:58.490387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:58.491924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:58.493877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a378ea9c-eb73-4a37-8ea9-bca99c484293 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.103233 Jul 21 22:50:58.494436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 729/1597] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:50:59.420148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:59.420772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:59.427735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:59.428182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:59.428995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:59.429425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:59.494468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:59.502072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-598c6215-f8a1-44a9-a784-80388df8e7a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085925 Jul 21 22:50:59.502629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 869/1598] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:50:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:50:59.512264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:50:59.512897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:50:59.519310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:59.519754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:59.520524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:50:59.520955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:50:59.583775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:59.592336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:59.593887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:50:59.595021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a72f0b57-4d5d-49a7-ae64-192ecc1eb6f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087721 Jul 21 22:50:59.595570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 730/1599] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:50:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:00.520001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:00.520628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:00.527900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:00.528346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:00.529129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:00.529573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:00.589646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:00.597073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dbf47c47-601a-4f60-95ca-f94a4ad1cc88 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081048 Jul 21 22:51:00.597629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 870/1600] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:00.612669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:00.613282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:00.620358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:00.620837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:00.621606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:00.622047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:00.685915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:00.688018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:00.695560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:00.697794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:00.698978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4ab9543c-5975-4564-a5c9-04e97952dd12 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090204 Jul 21 22:51:00.699836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 731/1601] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:01.614425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:01.615064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:01.621518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:01.621961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:01.622713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:01.623141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:01.688361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:01.695970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b2d86f31-6b73-4c21-96ac-2be8d44732c7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085334 Jul 21 22:51:01.697175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 871/1602] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:01.717620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:01.718245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:01.724891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:01.725333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:01.726097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:01.726524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:01.788122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:01.796640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:01.798177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:01.799312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-67093d6e-faaf-4f72-a22d-492396737be6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085837 Jul 21 22:51:01.799868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 732/1603] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:02.713994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:02.714600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:02.721043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:02.721493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:02.722262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:02.722699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:02.786399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:02.794590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-21a159b0-b625-405f-88d4-3917cc72ecf6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085052 Jul 21 22:51:02.795161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 872/1604] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:02.817217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:02.817831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:02.824709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:02.825185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:02.825934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:02.826371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:02.892748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:02.902303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:02.903812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:02.904985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d07ba651-7f28-45fc-8d57-e1a7ff7da4ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091702 Jul 21 22:51:02.905537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 733/1605] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:03.811960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:03.812589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:03.819338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:03.819787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:03.820580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:03.821058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:03.882667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:03.890743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4415734a-f930-4635-b534-c9f3b0d0f8b2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082678 Jul 21 22:51:03.891301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 873/1606] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:03.922781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:03.923384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:03.929872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:03.930325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:03.931635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:03.932063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:03.995163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:04.003478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:04.005011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:04.006147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb7f0da5-511e-4feb-8cd7-6503d8dbe0db tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087245 Jul 21 22:51:04.006695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 734/1607] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:04.908203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:04.908824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:04.915759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:04.916211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:04.917017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:04.917451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:04.984602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:04.992357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-324a9c55-24de-4388-8916-1a636ceedb02 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087972 Jul 21 22:51:04.993503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 874/1608] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:05.024578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:05.025295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:05.031693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:05.032148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:05.032966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:05.033410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:05.096772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:05.105882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:05.107409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:05.108590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-36b469a2-d844-455b-a192-937af7afdf36 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088186 Jul 21 22:51:05.109151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 735/1609] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:06.011653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:06.012240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:06.018707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:06.019150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:06.019902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:06.020364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:06.083775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:06.092716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f1243010-a02c-439a-8bef-d106b71354ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085752 Jul 21 22:51:06.093297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 875/1610] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:06.127198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:06.127843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:06.135344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:06.135794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:06.136610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:06.137052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:06.201970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:06.210357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:06.212510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:06.213661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5f4eb45a-42c4-41b4-8118-bf8418c4a9c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090380 Jul 21 22:51:06.214227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 736/1611] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:07.109869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:07.110484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:07.116984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:07.117432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:07.118419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:07.118860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:07.184297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:07.191807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e62fa9a5-3b6d-4f3c-a69b-89e02f2a895b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086248 Jul 21 22:51:07.192362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 876/1612] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:07.231872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:07.232515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:07.239061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:07.239516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:07.240281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:07.240758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:07.306979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:07.315325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:07.317014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:07.318165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b1c6df0b-7062-4b04-ba68-274698cc8962 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091021 Jul 21 22:51:07.318726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 737/1613] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:08.208687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:08.209329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:08.216321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:08.216799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:08.217559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:08.218025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:08.280193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:08.287780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-021eee4f-f2f4-4bc1-881a-20a7bc894789 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082924 Jul 21 22:51:08.288391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 877/1614] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:08.336792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:08.337384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:08.343929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:08.344380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:08.345184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:08.345618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:08.410314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:08.419099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:08.420642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:08.421786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b8d03e0e-4c4c-4329-880d-969c730f0d0f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089029 Jul 21 22:51:08.422335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 738/1615] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:09.304212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:09.304856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:09.311738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:09.312179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:09.312958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:09.313385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:09.380939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:09.389604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bd25a9e0-8241-4c0d-9386-4c5b60a97df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089236 Jul 21 22:51:09.390162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 878/1616] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:09.439210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:09.439821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:09.447584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:09.448033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:09.448835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:09.449273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:09.512509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:09.520993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:09.522502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:09.523675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-28d85fd0-a4f9-4454-a2ec-518dac7d0d05 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088450 Jul 21 22:51:09.524815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 739/1617] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:10.406506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:10.407124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:10.414202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.414633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.415590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.416027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.485607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:10.493335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce79617a-1cd6-46d2-87da-4bcb510c847c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.090532 Jul 21 22:51:10.493774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 879/1618] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:10.542333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:10.543051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:10.549497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.549952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.550722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:10.551156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:10.612498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:10.621252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:10.622774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:10.623909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ffa5b78e-ce88-4865-9222-6678df4496b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086019 Jul 21 22:51:10.624459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 740/1619] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:11.511454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:11.512108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:11.518683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.519135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.519901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.520338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.581374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:11.589541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0e51858a-21e2-4d1b-951a-c8a38502ff29 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083194 Jul 21 22:51:11.590103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 880/1620] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:11.642735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:11.643366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:11.650383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.650825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.651582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:11.652013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:11.717813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:11.726280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:11.728444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:11.729604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-324ef2b5-f8e7-42bf-ba5a-c410eb873935 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090738 Jul 21 22:51:11.730155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 741/1621] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:12.607254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:12.607854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:12.609752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:12.614908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:12.615348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:12.616101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:12.616558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:12.681032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:12.688650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-00ac8f0c-4081-4f71-986b-ca4f7ed14d5c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086037 Jul 21 22:51:12.689156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 881/1622] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:12.747530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:12.748135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:12.754574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:12.755020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:12.755777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:12.756208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:12.819121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:12.828159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:12.829710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:12.830854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-11d9c8d4-3e87-4612-9428-4dbfb722930d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087300 Jul 21 22:51:12.831407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 742/1623] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:13.706682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:13.707239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:13.713961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:13.714408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:13.715164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:13.715595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:13.776867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:13.784401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0dd1d2a4-6e66-4f08-912d-56dc10e3b2ab tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081733 Jul 21 22:51:13.784981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 882/1624] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:13.849521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:13.850127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:13.853608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=56 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:13.858922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:13.859367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:13.860134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:13.860597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:13.924406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:13.932880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:13.934417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:13.935578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-07a87b30-736c-4c05-abde-5a4f1723f711 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089995 Jul 21 22:51:13.936135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 743/1625] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:14.801684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:14.802320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:14.809501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:14.809982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:14.810748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:14.811182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:14.826339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:14.881667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:14.890935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d3bcaa6-e653-4481-b826-3f5d41e70e35 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.093079 Jul 21 22:51:14.891545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 883/1626] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:14.914920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d885e5ed-d4e9-418c-9b8e-1c321fdaf471 tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] Calling method '.version_select at 0x7ff1da7fcaf0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:14.940082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d885e5ed-d4e9-418c-9b8e-1c321fdaf471 tempest-TestVolumeBootPattern-1509083020 tempest-TestVolumeBootPattern-1509083020-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-575535448" status: 202 len: 0 microversion: 2.1 time: 0.029275 Jul 21 22:51:14.940633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 744/1627] 10.222.0.42 () {58 vars in 1259 bytes} [Thu Jul 21 22:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-575535448 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:51:14.955334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:14.955974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:14.963048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:14.963499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:14.964266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:14.964738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:15.029970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:15.038310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:15.040354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:15.041536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9515e54b-0566-4fa1-981f-47984ebf2fdf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090156 Jul 21 22:51:15.042088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 884/1628] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:15.896329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:51:15.897055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:51:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:51:15.909340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:15.909957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:15.916403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:15.917030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:15.917645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:15.918084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:15.980644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:15.988132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15aa9e70-6b1f-4e8d-9856-d32e21b1a923 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082621 Jul 21 22:51:15.988734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 745/1629] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:51:16.059335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:16.059948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:16.066386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:16.066842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:16.067610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:16.068046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:16.143611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:16.153502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:16.154976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:16.156147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3744717b-d1da-41f1-bc92-ffc812a5bfe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.100900 Jul 21 22:51:16.157147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 885/1630] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:17.005210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:17.005887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:17.013647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:17.014206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:17.014904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:17.015344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:17.082117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:17.090578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c67c4ac7-c2bc-4e86-b9e6-1173c03af735 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089185 Jul 21 22:51:17.096891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 746/1631] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:17.175507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:17.176787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:17.188840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:17.189515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:17.191383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:17.192493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:17.296020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:17.304517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:17.306297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:17.307528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1b99ff1a-6136-48e4-999f-3a5f58a24df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.136474 Jul 21 22:51:17.308167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 886/1632] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:18.112757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:18.113478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:18.122726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:18.123467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:18.124337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:18.124801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:18.201266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:18.209867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de056e4b-d26b-4be1-b10a-7d2151eda854 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.104904 Jul 21 22:51:18.210569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 747/1633] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:18.327525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:18.328411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:18.335357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:18.335959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:18.338026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:18.338506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:18.432333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:18.442730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:18.444569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:18.445829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3e24157c-59b9-487f-9f7b-1df3ecb66dc4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.124647 Jul 21 22:51:18.446400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 887/1634] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:19.227723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:19.228434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:19.236022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:19.236521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:19.237302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:19.237749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:19.335142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:19.355497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-83aac015-a589-4233-879c-1da5ea7a5e7a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.131964 Jul 21 22:51:19.362141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 748/1635] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:19 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:19.464229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:19.465495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:19.472499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:19.473005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:19.473794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:19.474305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:19.544694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:19.553212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:19.554715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:19.559073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-388bd6ae-d2a3-48cf-8da8-0e911cb8959b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.097403 Jul 21 22:51:19.559641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 888/1636] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:20.373426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:20.374685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:20.381689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:20.382912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:20.386102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:20.386892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:20.405467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:20.465494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:20.473885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-54e57a82-4625-46d5-b48c-26c93c763667 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.104366 Jul 21 22:51:20.474468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 749/1637] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:20.579150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:20.579529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:20.586261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:20.586703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:20.587656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:20.588082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:20.676366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:20.686375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:20.688024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:20.689254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fb6b9ee2-e8da-460c-bd80-3602b7e22ade tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.115506 Jul 21 22:51:20.689816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 889/1638] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:21.491464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:21.493538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:21.504312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:21.505029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:21.506772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:21.509090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:21.619250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:21.628513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f487e66b-780f-411f-8b0e-0aa4a251a97b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.141604 Jul 21 22:51:21.629558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 750/1639] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:21.707218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:21.708057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:21.715586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:21.716241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:21.717037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:21.717635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:21.784270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:21.793832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:21.795357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:21.796542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-30dde9de-1f31-4681-8e50-9d0da2e3e11a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093283 Jul 21 22:51:21.797096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 890/1640] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:22.645832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:22.646506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:22.653468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.653922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.654701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.655165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.725552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:22.734247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b57cc169-1e13-46fd-b528-eae79b3cd72a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.092581 Jul 21 22:51:22.734853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 751/1641] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:22.815445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:22.816067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:22.823563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.824009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.824828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:22.825264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:22.893826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:22.903329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:22.904851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:22.905986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4ac9d7c3-0379-4c3c-8fdf-757c6f17920d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094796 Jul 21 22:51:22.906532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 891/1642] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:23.751940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:23.752590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:23.759434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.759882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.760680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.761118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.822287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:23.829756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9131afc4-7735-4768-b7a7-391c6e84ea3d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081812 Jul 21 22:51:23.830320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 752/1643] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:23.926152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:23.926779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:23.933435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.933880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.934633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:23.935065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:23.996986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:24.005457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:24.006906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:24.008724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94f60ac1-cc9e-489e-b27e-c7d6dc764648 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085867 Jul 21 22:51:24.009288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 892/1644] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:24.847210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:24.847820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:24.854904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:24.855351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:24.856116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:24.856592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:24.919020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:24.926527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ca0e8291-b6ad-4f29-ab80-9239eb077026 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083205 Jul 21 22:51:24.927141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 753/1645] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:51:25.027497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:25.028105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:25.034728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:25.035177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:25.035941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:25.036375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:25.103146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:25.111623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:25.113161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:25.114295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b80e4a97-a103-4036-961e-a2a3543e186b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091686 Jul 21 22:51:25.114847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 893/1646] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:25.944180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:25.944798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:25.951962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:25.952406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:25.953191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:25.953620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:26.017232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:26.025143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-13e1fc53-cb4c-4fe8-b2c8-2855824d22cf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085011 Jul 21 22:51:26.025704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 754/1647] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:26.132542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:26.133478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:26.140023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:26.140468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:26.141272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:26.141701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:26.205056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:26.213278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:26.214781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:26.215910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f7970292-1bbd-4ef7-a1a1-8d8dae482583 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087332 Jul 21 22:51:26.216457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 894/1648] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:27.041223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:27.041845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:27.048351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:27.048839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:27.049607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:27.050045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:27.113553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:27.121835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dc45198c-d446-4648-ae62-1f66947ce478 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084418 Jul 21 22:51:27.122425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 755/1649] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:27 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:27.233457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:27.234063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:27.240495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:27.240954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:27.241719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:27.242179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:27.304584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:27.313798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:27.315301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:27.316431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dd1c2928-a727-452e-a372-9c23cf06d9a6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086949 Jul 21 22:51:27.317012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 895/1650] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:28.138980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:28.139592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:28.146090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:28.146543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:28.147316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:28.147749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:28.209100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:28.217125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e042adc8-0a8a-44dd-b4c4-b620bc9c8670 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082047 Jul 21 22:51:28.217690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 756/1651] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:28.334154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:28.334772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:28.342721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:28.343166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:28.343926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:28.344356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:28.406838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:28.416059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:28.417624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:28.418789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6a920db8-ece2-43c5-9faf-7873a11e7e9f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088612 Jul 21 22:51:28.419391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 896/1652] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:29.233981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:29.234599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:29.241181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:29.241631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:29.242403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:29.242862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:29.308917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:29.316500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bf15c6c2-3340-4ff5-b841-9c2d2428b02d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086441 Jul 21 22:51:29.317069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 757/1653] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:29.436463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:29.437087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:29.443532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:29.443974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:29.444786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:29.445215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:29.511497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:29.520205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:29.521735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:29.522880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4c4d38cc-7928-402d-874f-c8a0e8a4652a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090336 Jul 21 22:51:29.523431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 897/1654] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:30.333843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:30.334468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:30.341289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:30.341745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:30.342515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:30.342955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:30.407689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:30.415663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a9b35909-30a9-4265-8d08-ff6bf6e6c93c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085629 Jul 21 22:51:30.416284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 758/1655] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:30.540208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:30.540827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:30.547279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:30.547722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:30.548501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:30.548931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:30.609692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:30.619437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:30.620986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:30.622139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12991855-9a83-4854-ae8b-fc3393dbc38e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085835 Jul 21 22:51:30.622692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 898/1656] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:31.432774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:31.433313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:31.439809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:31.440255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:31.441040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:31.441473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:31.503861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:31.512597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3eb6a7d-0b23-46a4-8711-bb32c9409d86 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083838 Jul 21 22:51:31.513154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 759/1657] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:31.640277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:31.640860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:31.647371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:31.647821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:31.649323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:31.649741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:31.716609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:31.724956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:31.726474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:31.727622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-91594fe3-88e9-47e3-90e8-ac2c4df41b73 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091357 Jul 21 22:51:31.728175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 899/1658] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:32.529728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:32.530338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:32.536903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:32.537350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:32.538107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:32.538538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:32.599331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:32.607575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4d2ae620-35b7-4d56-8de1-4309da346253 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081776 Jul 21 22:51:32.608129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 760/1659] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:32.745538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:32.746145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:32.752682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:32.753135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:32.753895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:32.754326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:32.756856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:32.815741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:32.824253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:32.825796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:32.826974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-536d1678-4a6b-4020-94eb-c93cdc9790e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085576 Jul 21 22:51:32.827523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 900/1660] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:33.624635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:33.625234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:33.631791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:33.632234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:33.633276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:33.633702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:33.694955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:33.702989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6745e4d-6627-4b69-8562-ecf831e67ed2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082273 Jul 21 22:51:33.703559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 761/1661] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:33.845017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:33.845629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:33.852838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:33.853289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:33.854080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:33.854493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:33.921678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:33.930701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:33.932202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:33.933363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b4814f16-3d85-4a03-93d9-204fd4115d59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092269 Jul 21 22:51:33.933924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 901/1662] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:34.720465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:34.721045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:34.727891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:34.728340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:34.729146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:34.729584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:34.793698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:34.801171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2a18a545-e27b-4745-b5b9-7153b42d9315 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084680 Jul 21 22:51:34.801733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 762/1663] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:34.951768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:34.952374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:34.958859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:34.959304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:34.960058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:34.960505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:35.025232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:35.033824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:35.035344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:35.036509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf4feb83-d6ed-4051-81a3-77f50ce2a4c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088687 Jul 21 22:51:35.037131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 902/1664] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:35.818744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:35.819364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:35.826458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:35.826903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:35.827666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:35.828090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:35.891212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:35.899303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-074a915c-7808-43c6-a121-6c73edb3e7b4 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083798 Jul 21 22:51:35.899873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 763/1665] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:36.053751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:36.054353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:36.060898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:36.061341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:36.062090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:36.062518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:36.124646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:36.134151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:36.135662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:36.136831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-41b9dc2e-f162-4fe3-a072-41e2e187464f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086980 Jul 21 22:51:36.137381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 903/1666] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:36.916558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:36.917158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:36.923773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:36.924220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:36.925025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:36.925458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:36.986579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:36.994780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d24a0ce-8b8c-4d58-ac6e-24ba0e6e8caf tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082676 Jul 21 22:51:36.995349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 764/1667] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:37.155865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:37.156492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:37.162927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:37.163391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:37.164130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:37.165218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:37.226065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:37.235342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:37.236891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:37.238065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dbf4d552-c200-48fd-8911-18c9ebf37d28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086160 Jul 21 22:51:37.238620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 904/1668] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:38.012453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:38.013036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:38.019605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:38.020056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:38.020858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:38.021299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:38.083445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:38.091677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2cbb9c3c-ad7d-4a9e-a99f-052c83ae7fe0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084011 Jul 21 22:51:38.092248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 765/1669] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:38.256429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:38.257054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:38.264206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:38.264603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:38.265360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:38.265788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:38.337843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:38.346419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:38.347948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:38.349143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92dfc1a5-fb94-4fb2-9ae3-0e9e418bc9a9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.096756 Jul 21 22:51:38.349949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 905/1670] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:39.108564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:39.109183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:39.115634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:39.116057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:39.116853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:39.117280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:39.119953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:39.186352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:39.193915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f05ee542-c5ea-4455-809d-8d9c2f707c79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089272 Jul 21 22:51:39.194481 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 766/1671] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:39 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:39.367491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:39.368664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:39.375323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:39.375771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:39.376560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:39.377030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:39.440932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:39.450337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:39.451843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:39.453028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b7d24960-a121-4386-b5f1-7ac238ec84b3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089576 Jul 21 22:51:39.453582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 906/1672] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:40.211043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:40.212154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:40.218786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:40.219235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:40.219986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:40.220414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:40.281615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:40.289820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ff3edd31-6a39-4fb8-ae3a-90c6a02f4ee6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082174 Jul 21 22:51:40.291122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 767/1673] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:40.471119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:40.471675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:40.478308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:40.478774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:40.479501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:40.479930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:40.542822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:40.551025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:40.552536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:40.553663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3853652c-63d3-462a-a4d9-ca8fc79f0d09 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086571 Jul 21 22:51:40.554212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 907/1674] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:41.308426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:41.309111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:41.315809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:41.316254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:41.317044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:41.317476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:41.380723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:41.389018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9270adf8-4ea7-44aa-b9c4-2b2dd4e56689 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085001 Jul 21 22:51:41.389592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 768/1675] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:41.572469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:41.573077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:41.579620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:41.580065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:41.580848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:41.581280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:41.642137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:41.651477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:41.653031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:41.654184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8a98a1d8-e510-4313-afad-1d4a4fe60bc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085845 Jul 21 22:51:41.654732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 908/1676] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:42.405816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:42.406425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:42.412869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:42.413326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:42.414085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:42.414522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:42.477342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:42.484719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d1f56974-ad1c-4552-8766-556d1bfcd0b7 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082750 Jul 21 22:51:42.485277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 769/1677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:42.672136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:42.672696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:42.674710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=56 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:42.680143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:42.681201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:42.682084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:42.682520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:42.747210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:42.755629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:42.757173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:42.759218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46563728-1d87-4a34-a694-b5078f14318f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090188 Jul 21 22:51:42.759780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 909/1678] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:43.502508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:43.503117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:43.510661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:43.511187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:43.511869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:43.512294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:43.579718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:43.588257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a51aa73e-37c4-46ba-9f6a-7e713af60f1d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089654 Jul 21 22:51:43.588853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 770/1679] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:43.777170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:43.777725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:43.784055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:43.784519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:43.785275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:43.785706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:43.847231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:43.855934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:43.857490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:43.858681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a41c49b2-dfc0-45e2-8369-7d54687bb2c4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085575 Jul 21 22:51:43.859237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 910/1680] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:44.604664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:44.605282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:44.607565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:44.613025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:44.613476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:44.614244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:44.614680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:44.678128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:44.686294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-58a23d27-4df2-4d2c-8a57-9cc2b65598ac tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086088 Jul 21 22:51:44.686792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 771/1681] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:44.876504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:44.877144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:44.884932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:44.885097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:44.885855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:44.886283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:44.947324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:44.955828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:44.957415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:44.958556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b24c23ca-d22c-40af-97ec-1a946196e244 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085965 Jul 21 22:51:44.959103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 911/1682] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:45.702733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:45.703275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:45.709785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:45.710237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:45.711004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:45.711439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:45.775127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:45.782652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ccd0fc6f-9d6d-4875-8cee-cf01d9d8a48b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083867 Jul 21 22:51:45.783213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 772/1683] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:45.978182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:45.979080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:45.985358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:45.985799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:45.986546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:45.986973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:46.048349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:46.056832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:46.058336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:46.059501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a7698aaf-e6de-40d4-b973-570ab3c0d986 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085994 Jul 21 22:51:46.060065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 912/1684] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:46.799724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:46.800332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:46.807502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:46.807943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:46.808729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:46.809162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:46.870837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:46.878266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-baa6c192-dcdf-4037-b46e-e827d40a9e2f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082387 Jul 21 22:51:46.878814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 773/1685] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:47.078001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:47.078535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:47.085304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:47.085808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:47.086621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:47.087235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:47.156033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:47.164609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:47.166664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:47.167817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b16e96d-b2e7-4fcc-b000-3d4d846e63b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093834 Jul 21 22:51:47.168402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 913/1686] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:47.895822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:47.896431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:47.903943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:47.904380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:47.905174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:47.905602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:47.969869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:47.977614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1d89c0a9-9f05-4003-a18d-38513e09293e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085429 Jul 21 22:51:47.978202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 774/1687] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:48.186097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:48.186659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:48.193136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:48.193583 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:48.194342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:48.194777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:48.259650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:48.268122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:48.269704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:48.270856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94df9b31-e593-4d44-bbbc-e5420c213f7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088804 Jul 21 22:51:48.271410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 914/1688] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:48.994782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:48.995431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:49.002193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:49.002647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:49.003424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:49.003860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:49.067396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:49.075043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c8486892-86be-4599-9204-8d41c16ca000 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084702 Jul 21 22:51:49.075602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 775/1689] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:49.288768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:49.289417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:49.297780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:49.298229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:49.299001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:49.299432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:49.361563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:49.370334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:49.371912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:49.373191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8dde3683-f33a-45f2-85dd-9b996b98a744 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088392 Jul 21 22:51:49.373739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 915/1690] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:50.091917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:50.092538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:50.099038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:50.099480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:50.100304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:50.100719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:50.167059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:50.174776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4e6787a2-ddc6-4ec9-8485-ca2055bb5bfa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086662 Jul 21 22:51:50.175355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 776/1691] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:50 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:50.391827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:50.392378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:50.398810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:50.399333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:50.400177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:50.400699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:50.464648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:50.466854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:50.474526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:50.476122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:50.477984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2032053d-0099-4b67-a574-0c6f2afc9bc0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089488 Jul 21 22:51:50.478717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 916/1692] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:51.192227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:51.192879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:51.199858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:51.200305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:51.201106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:51.201546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:51.263773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:51.271514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6c3eaef-0056-493d-b9b0-b44be69271fe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083122 Jul 21 22:51:51.272116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 777/1693] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:51.496100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:51.496726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:51.503083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:51.503526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:51.504277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:51.504730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:51.569499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:51.578899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:51.580421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:51.581655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f4ed6b22-fc98-4cbb-8940-c6297ae56a69 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090430 Jul 21 22:51:51.582214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 917/1694] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:52.288619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:52.289231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:52.298189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:52.298638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:52.299410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:52.299848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:52.367524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:52.379450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8b271f47-3b95-4246-981f-868ab36ea05c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.094538 Jul 21 22:51:52.380290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 778/1695] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:52.599901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:52.600561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:52.607515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:52.607962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:52.608751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:52.609187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:52.671527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:52.680217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:52.681990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:52.683471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-af2359ca-aca7-4809-abc6-14d33fbe6521 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087375 Jul 21 22:51:52.684313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 918/1696] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:51:53.397834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:53.398436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:53.405023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:53.405468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:53.406231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:53.406664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:53.703482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:53.704438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:53.706048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:53.711335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:53.712459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:53.713846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:53.714283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:53.716870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2450284c-874a-4e7c-8ade-082ed800e208 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.322407 Jul 21 22:51:53.717908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 779/1697] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:53.781960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:53.791348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:53.793028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:53.794191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e72400e1-8627-496b-b7c5-4ed79adde9f6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094810 Jul 21 22:51:53.794740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 919/1698] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:54.734731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:54.735262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:54.741865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:54.742308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:54.743671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:54.744074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:54.811785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:54.812471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:54.816978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:54.819523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:54.819977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:54.820761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:54.821338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:54.826657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7f368536-e504-4952-90c5-3104a7c471b0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.095921 Jul 21 22:51:54.827451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 780/1699] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:54.885472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:54.894133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:54.895640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:54.896838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1e113e54-b74a-4cf7-82b4-caf0071a1760 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088930 Jul 21 22:51:54.897394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 920/1700] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:55.843223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:55.843831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:55.850394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:55.850846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:55.851623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:55.852033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:55.913888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:55.914791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:55.915398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:55.921881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fff79d6d-d8e7-4aec-a708-14deebd06b99 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082429 Jul 21 22:51:55.922059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:55.922328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:55.922734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 781/1701] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:55.923085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:55.923512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:55.988874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:55.998390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:55.999883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:56.001047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e95ebc16-d59d-42c2-8702-0f5788b88aa2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090228 Jul 21 22:51:56.001606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 921/1702] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:56.939270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:56.939883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:56.947525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:56.947972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:56.948774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:56.949209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:57.014967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:57.017180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:51:57.020076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:57.020719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:57.024093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-17f479ac-4757-4fa0-8119-3e8236516784 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.088548 Jul 21 22:51:57.025178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 782/1703] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:57.028233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:57.028725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:57.029497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:57.029936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:57.093538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:57.102182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:57.103800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:57.105021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b1973c4e-699a-4531-b10d-3b629d2022eb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088903 Jul 21 22:51:57.105554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 922/1704] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:58.042505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:58.043114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:58.049621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:58.050069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:58.050840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:58.051269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:58.115167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:58.122834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-02338017-1ac2-46eb-b19b-8f378e300b2c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084977 Jul 21 22:51:58.123398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 783/1705] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:51:58.123540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:58.124128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:58.132358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:58.132837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:58.134545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:58.134985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:58.198776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:58.207449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:58.209580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:58.210867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b4abca34-ab6f-43a2-8f16-631bef157270 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091110 Jul 21 22:51:58.212188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 923/1706] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:51:59.141276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:59.141958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:59.148871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:59.149389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:59.150154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:59.150695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:59.224034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:59.232998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:51:59.233577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8a91a5f2-9e60-4376-ac14-9c7954a8773d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.097458 Jul 21 22:51:59.233679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:51:59.237506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 784/1707] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:51:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:51:59.241083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:59.241607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:59.242434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:51:59.243499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:51:59.313305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:59.321826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:59.323334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:51:59.324504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c1e4dd69-c764-4adb-8701-21e0bcb24fa7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.099044 Jul 21 22:51:59.325291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 924/1708] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:51:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:52:00.251487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:00.252104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:00.260258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:00.260730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:00.261501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:00.261939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:00.324827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:00.332382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-13bfd0e6-5020-4c89-aa85-1ac37f0d1d01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084680 Jul 21 22:52:00.332905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 785/1709] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:00 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:00.343162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:00.343761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:00.350167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:00.350610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:00.351365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:00.351791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:00.416800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:00.425372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:00.426886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:00.428029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-203ef23f-f9f3-4c84-a0fa-15af06dbd8fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088744 Jul 21 22:52:00.428609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 925/1710] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:01.349526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:01.350160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:01.356902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:01.357348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:01.358103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:01.358540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:01.426553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:01.437357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-88719535-984c-4516-bb39-21b63fafd26a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.091121 Jul 21 22:52:01.438011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 786/1711] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:01.446699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:01.447439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:01.456116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:01.456582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:01.457341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:01.457767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:01.520509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:01.530126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:01.531629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:01.532807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-36f49b71-e116-4d76-aa7b-2e8e90baccbf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090526 Jul 21 22:52:01.533354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 926/1712] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:52:02.455409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:02.456011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:02.463213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:02.463655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:02.464410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:02.464865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:02.526100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:02.533624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb250e2a-9af9-41da-8452-466e694928ff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082160 Jul 21 22:52:02.534189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 787/1713] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:02.550783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:02.551388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:02.558097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:02.558549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:02.559314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:02.559751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:02.622588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:02.630953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:02.632466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:02.634116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e7e19628-6eb5-4155-9c80-53a94065a624 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087049 Jul 21 22:52:02.634674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 927/1714] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:03.550538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:03.551151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:03.558204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:03.558650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:03.559405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:03.559839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:03.621846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:03.629393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6cffce10-acfe-404f-bbac-cec0a460d796 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082784 Jul 21 22:52:03.629953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 788/1715] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:03.651058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:03.651708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:03.658160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:03.658598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:03.659352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:03.659826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:03.722551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:03.731560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:03.733092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:03.734234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cf584dda-e303-4212-b187-d58522fffa87 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087106 Jul 21 22:52:03.734801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 928/1716] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:04.646793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:04.647406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:04.655062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:04.655513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:04.656276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:04.656741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:04.720628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:04.728226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c0a99cc9-8098-45ff-982a-80a6b7f25f16 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085354 Jul 21 22:52:04.728824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 789/1717] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:04.753656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:04.754257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:04.761755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:04.762199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:04.762952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:04.763381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:04.827621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:04.836092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:04.837743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:04.838900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5598759-bf54-444a-8d90-1a14977abed4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089118 Jul 21 22:52:04.839465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 929/1718] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:05.745470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:05.746083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:05.752544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:05.752990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:05.753747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:05.754179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:05.821181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:05.829041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5740f9f4-3c05-429e-9ff4-0f90e162bffd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087785 Jul 21 22:52:05.829613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 790/1719] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:05.856769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:05.857400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:05.863785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:05.864224 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:05.865010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:05.865438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:05.927389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:05.936047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:05.937580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:05.938724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e579f953-08ff-41f5-b249-9ffa6fb7f9af tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085928 Jul 21 22:52:05.939271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 930/1720] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:06.847332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:06.847947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:06.855570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:06.856022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:06.856825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:06.857267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:06.919561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:06.927008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4fe92a9d-ed43-4b0c-8218-3294baf6c0a8 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083686 Jul 21 22:52:06.927572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 791/1721] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:06.957084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:06.957717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:06.964794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:06.965238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:06.965989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:06.966416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:07.027758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:07.036201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:07.037724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:07.038883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f561ce5a-84f9-4a5d-b68e-1fb574b964d7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085748 Jul 21 22:52:07.040059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 931/1722] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:07.944607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:07.945247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:07.952952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:07.953406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:07.954169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:07.954632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:08.017308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:08.024818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c0542f7e-6f73-42d7-b4e3-756e0c3fca12 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084058 Jul 21 22:52:08.025386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 792/1723] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:08.057023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:08.057622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:08.064248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:08.064783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:08.065547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:08.065975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:08.130456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:08.139399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:08.140926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:08.142066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecc21443-6bd7-4374-ab43-2b3217dcb1f5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089505 Jul 21 22:52:08.142614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 932/1724] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:09.042072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:09.042714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:09.049197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:09.049645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:09.050430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:09.050866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:09.116925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:09.128286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-abacad6e-fd46-47ba-9354-629c4e677f2e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.090246 Jul 21 22:52:09.129164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 793/1725] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:09.160340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:09.160978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:09.167566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:09.168008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:09.168790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:09.169220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:09.184255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:09.235052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:09.244245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:09.245775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:09.246915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fbc1bbd9-c114-4756-95cb-509a86725740 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090570 Jul 21 22:52:09.247472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 933/1726] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:10.147123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:10.147713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:10.154931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:10.155378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:10.156143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:10.156607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:10.221274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:10.230024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-54ad1202-9092-46ef-b534-ff024969789f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086807 Jul 21 22:52:10.230592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 794/1727] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:10.264932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:10.265535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:10.271913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:10.272354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:10.273156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:10.274081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:10.337529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:10.345893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:10.347389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:10.349305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5520c890-068c-49c2-9a75-704399e9aaa0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087486 Jul 21 22:52:10.349305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 934/1728] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:11.247200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:11.247815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:11.254348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:11.254798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:11.255571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:11.256006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:11.320176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:11.328053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c6218cb6-69f7-429f-af25-9e3168d18906 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084737 Jul 21 22:52:11.328640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 795/1729] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:11 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:11.366160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:11.366795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:11.373853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:11.374297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:11.375055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:11.375515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:11.440515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:11.449296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:11.450812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:11.451967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bbdb11c5-e511-4ce7-9749-e533af8a92ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089745 Jul 21 22:52:11.452536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 935/1730] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:12.345271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:12.345891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:12.352549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:12.353006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:12.353781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:12.354257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:12.422700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:12.431071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de78e2c8-a8aa-46af-8998-cb0ecba3c5a6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089614 Jul 21 22:52:12.431639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 796/1731] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:12.470832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:12.471436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:12.477443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:12.477883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:12.478671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:12.479102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:12.538986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:12.547476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:12.549010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:12.550159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1395398e-60d1-4140-bc38-a74fc0b2bd63 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.083465 Jul 21 22:52:12.550712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 936/1732] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:13.448624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:13.449200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:13.455719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:13.456162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:13.456943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:13.457369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:13.517520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:13.525708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0ebf688a-bc59-4b06-9353-08e95ce51792 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081806 Jul 21 22:52:13.526268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 797/1733] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:13.568488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:13.569128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:13.572301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=56 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:13.577592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:13.578042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:13.578807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:13.579243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:13.644793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:13.653958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:13.655470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:13.656660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ec942c18-c849-407a-81e9-51a3ce33e264 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092073 Jul 21 22:52:13.657215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 937/1734] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:14.542630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:14.543267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:14.549728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:14.550170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:14.550969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:14.551356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:14.616500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:14.624023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3f8c7922-e161-4d64-a650-4e419ec0ff00 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085376 Jul 21 22:52:14.624677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 798/1735] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:14.674762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:14.675367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:14.682492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:14.682935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:14.683748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:14.684127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:14.746836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:14.755360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:14.756905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:14.758314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0af5974a-2838-48cd-baf1-bfdae4d79738 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087251 Jul 21 22:52:14.758868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 938/1736] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:15.641047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:15.644944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:15.647265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=56 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:15.653380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:15.653826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:15.654593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:15.655027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:15.670940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:15.718908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:15.726577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-204071c0-0259-4b9c-96c3-bd61eae25df5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089735 Jul 21 22:52:15.727141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 799/1737] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:15 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:15.775753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:15.777306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:15.783498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:15.783946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:15.784734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:15.785166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:15.847605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:15.856801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:15.858317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:15.859459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-243110c7-0d94-44d9-9df8-619c6ec40dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087560 Jul 21 22:52:15.860020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 939/1738] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:16.743193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:16.743736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:16.751037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:16.751472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:16.752224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:16.752690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:16.814358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:16.821879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4c411d42-31e5-49b7-bcef-c4bdc5d832de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082629 Jul 21 22:52:16.822442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 800/1739] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:16 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:16.877248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:16.877842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:16.884461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:16.884931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:16.885733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:16.886170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:16.946293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:16.954848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:16.956344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:16.957507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-93b423d2-29f4-4ff9-8578-675674c28dd0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084116 Jul 21 22:52:16.958064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 940/1740] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:17.838581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:17.839191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:17.845681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:17.846131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:17.846923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:17.847357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:17.910371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:17.917943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c58f64db-7cac-40d8-b792-81828370e17f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083245 Jul 21 22:52:17.918505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 801/1741] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:17 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:17.975105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:17.975707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:17.982805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:17.983249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:17.984013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:17.984446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:18.050598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:18.060229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:18.061778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:18.062938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2c81716f-ca24-4a9e-b40e-191aa7ad7515 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091714 Jul 21 22:52:18.063491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 941/1742] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:18.934794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:18.935358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:18.941871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:18.942316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:18.943078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:18.943513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:19.009207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:19.017633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6637915-15d3-4ec1-bf8f-ea42e73a7434 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087325 Jul 21 22:52:19.018209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 802/1743] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:18 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:19.081887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:19.082493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:19.089575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:19.090017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:19.090806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:19.091238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:19.153069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:19.161765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:19.163254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:19.164391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-efa6ccc2-3633-4b86-a30d-8476d3793ad6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086457 Jul 21 22:52:19.164993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 942/1744] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:20.181333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:20.182009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:20.189129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:20.189581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:20.190362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:20.190799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:20.254796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:20.263590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:20.265138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:20.266291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ebe058b9-6c88-4656-8f12-8699db856aa9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088897 Jul 21 22:52:20.266851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 943/1745] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:52:20.319917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:20.320572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:20.326906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:20.327350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:20.328110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:20.328570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:20.397807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:20.405888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c06391fd-5c98-4bd5-86be-8c7f758cc29a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.374487 Jul 21 22:52:20.406389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 803/1746] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:20 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:21.285143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:21.285753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:21.292933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:21.293381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:21.294144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:21.294671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:21.356048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:21.364459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:21.366003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:21.367157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cf5830d9-55ff-419b-a1a9-24d49b47b4e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085900 Jul 21 22:52:21.367706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 944/1747] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:21.423281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:21.423895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:21.430655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:21.431107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:21.431877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:21.433581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:21.497299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:21.505107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7401c5f5-7491-49bc-9a1e-9d4bf1233cb5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085681 Jul 21 22:52:21.505676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 804/1748] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:21 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:22.386594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:22.387192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:22.393701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:22.394150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:22.394912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:22.395347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:22.459437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:22.467978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:22.469523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:22.470668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-913a4210-600a-4a4f-9653-de68d77d9bc9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089144 Jul 21 22:52:22.471221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 945/1749] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:22.522313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:22.522921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:22.529681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:22.530126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:22.530888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:22.531321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:22.592582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:22.600025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e116301d-1efe-490f-9862-3ee16b67e4eb tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081543 Jul 21 22:52:22.600604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 805/1750] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:22 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:23.246937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:52:23.247184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:52:23.489772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:23.490342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:23.496865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:23.497303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:23.498215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:23.498735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:23.561558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:23.570020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:23.571526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:23.573291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7fd51122-9077-4edf-9fea-f9b2bfbeebe8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086921 Jul 21 22:52:23.573798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 946/1751] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:23.616092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:23.616741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:23.623859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:23.624337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:23.625079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:23.625515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:23.695580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:23.708341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2c2abb5f-2cad-4785-aa4f-e22947865a5b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.095615 Jul 21 22:52:23.709511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 806/1752] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:23 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:24.591815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:24.592426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:24.598908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:24.599356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:24.600113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:24.600566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:24.664622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:24.674166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:24.676075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:24.677314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bae56afc-f07d-42dc-81ff-2a0b8072655a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089980 Jul 21 22:52:24.677878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 947/1753] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:24.726313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:24.726884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:24.734245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:24.734693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:24.735487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:24.735926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:24.799246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:24.807062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef8a4316-29b4-4684-89e9-1b4902bc30c9 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084688 Jul 21 22:52:24.807630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 807/1754] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:24 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:25.695109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:25.695690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:25.702783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:25.703225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:25.703985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:25.704412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:25.765806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:25.774196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:25.775706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:25.776942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4f86cf07-5ba1-427c-bd4f-0b5477d064d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085819 Jul 21 22:52:25.777492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 948/1755] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:25.823514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:25.824128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:25.830699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:25.831151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:25.831915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:25.832353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:25.894359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:25.901987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dd020e14-bd8b-4689-b9ae-38aa83d1c736 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082830 Jul 21 22:52:25.902541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 808/1756] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:25 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:26.794999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:26.795612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:26.802071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.802606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.803404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.803783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.867595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:26.876881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:26.878385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:26.879526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8edb0079-0734-48a3-a368-0f69d2f37bb8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088566 Jul 21 22:52:26.880085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 949/1757] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:26.918589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:26.919224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:26.925945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.926396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.927193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:26.927631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:26.990753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:26.998812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1416536b-d9dd-4c93-bba5-67bbb3debffa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084195 Jul 21 22:52:26.999508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 809/1758] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:26 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:27.898926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:27.899538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:27.907012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:27.907465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:27.908229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:27.908701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:27.912634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:27.970078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:27.978539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:27.980057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:27.981240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f30cb8eb-d8a3-49b2-a484-d874d604ebe1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086250 Jul 21 22:52:27.981799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 950/1759] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:28.015726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:28.016329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:28.022763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:28.023205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:28.023966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:28.024393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:28.090905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:28.098599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2691af20-1d0f-439f-a705-283353ff271a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087409 Jul 21 22:52:28.099165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 810/1760] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:28 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:28.999070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:28.999688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:29.006930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:29.007383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:29.008406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:29.008864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:29.069498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:29.078040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:29.079553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:29.080733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bffc80fc-452a-460a-b0f7-ee24ba4129a7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085564 Jul 21 22:52:29.081294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 951/1761] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:29.115037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:29.115654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:29.122242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:29.122692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:29.123456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:29.123890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:29.186216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:29.195486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-105792e8-2aa0-4de9-9069-2e1ac9a05c0e tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084160 Jul 21 22:52:29.196062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 811/1762] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:29 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:30.098668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:30.099252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:30.106269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:30.106720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:30.107488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:30.107923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:30.170554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:30.178963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:30.180464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:30.181627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-31c7b315-722d-4e2e-9f12-b9e2357a5d29 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086879 Jul 21 22:52:30.182186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 952/1763] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:30.212429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:30.213067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:30.219637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:30.220086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:30.220880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:30.221319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:30.284267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:30.293114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-452411d9-53b2-4031-b72d-d49ae12f16e0 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083923 Jul 21 22:52:30.294674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 812/1764] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:30 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:31.200654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:31.201708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:31.207780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:31.208234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:31.209037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:31.209473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:31.273841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:31.283018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:31.284552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:31.285704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e1146dcc-0a9b-42cc-bc31-2bf8aca7d343 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089588 Jul 21 22:52:31.286249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 953/1765] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:31.311702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:31.312316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:31.318810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:31.319262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:31.320023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:31.320465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:31.380428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:31.388773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-042beeb8-df9d-452d-ade4-17e6a2e28064 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081553 Jul 21 22:52:31.389343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 813/1766] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:31 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:32.304141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:32.304785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:32.311728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:32.312170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:32.312951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:32.313410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:32.376550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:32.385566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:32.387646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:32.388828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afbb610f-7ed1-4bc4-a460-c4a555f45c28 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088533 Jul 21 22:52:32.389385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 954/1767] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:32.406887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:32.407535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:32.414411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:32.414863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:32.415909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:32.416453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:32.482739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:32.490433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1612fb83-75b5-4dbd-9b09-a174019f2f4b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.088756 Jul 21 22:52:32.491000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 814/1768] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:32 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:33.406721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:33.407317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:33.413781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:33.414231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:33.414988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:33.415414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:33.476811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:33.485614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:33.487107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:33.488239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-19bd444e-6416-4018-9eb1-75c6b7c86328 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085432 Jul 21 22:52:33.488822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 955/1769] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:33.507355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:33.508255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:33.514970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:33.515423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:33.516195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:33.516677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:33.579244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:33.586895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6785fd8-c4e3-44ba-a8a6-b060546e5517 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083475 Jul 21 22:52:33.587458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 815/1770] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:33 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:34.506562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:34.507161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:34.514597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:34.515041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:34.515798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:34.516235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:34.577905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:34.586367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:34.587876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:34.589059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37d13899-dece-4f1b-8581-3f2bc3121ce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086484 Jul 21 22:52:34.590114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 956/1771] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:34.603021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:34.603629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:34.610411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:34.610859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:34.611623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:34.612054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:34.614630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:34.678292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:34.686608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a97a749a-83a6-480e-b7f6-728255af6794 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087336 Jul 21 22:52:34.687101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 816/1772] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:34 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:35.607607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:35.608326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:35.614762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:35.615211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:35.615969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:35.616404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:35.680165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:35.688787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:35.690297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:35.691438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-628f48a2-8806-4142-b11c-065c0fa00127 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087763 Jul 21 22:52:35.692002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 957/1773] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:35.704076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:35.704715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:35.711821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:35.712264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:35.713051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:35.713483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:35.774768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:35.783926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18bd9577-382f-44f4-a402-02bc0f30a3fa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083426 Jul 21 22:52:35.784948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 817/1774] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:35 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:36.710152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:36.710694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:36.718012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:36.718464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:36.719222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:36.719655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:36.781246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:36.789561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:36.791084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:36.792224 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-59fd600e-4850-4066-b4fd-69931810c10f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086107 Jul 21 22:52:36.793384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 958/1775] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:36.806493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:36.807110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:36.813716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:36.814165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:36.814929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:36.815363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:36.879105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:36.887507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be5c78c9-97f7-4c9a-894b-508b70209c06 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084747 Jul 21 22:52:36.888101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 818/1776] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:36 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:37.811413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:37.811998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:37.818707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:37.819150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:37.819912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:37.820334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:37.882099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:37.893091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:37.895052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:37.896241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bda2de1e-55b0-49d8-9aed-0a03ee03a356 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089500 Jul 21 22:52:37.896836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 959/1777] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:37.904637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:37.905262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:37.911802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:37.912249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:37.913045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:37.913483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:37.975324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:37.983910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-760f2570-a434-499a-9e70-f5804d3410ad tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083725 Jul 21 22:52:37.984464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 819/1778] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:37 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:38.914546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:38.915140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:38.921566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:38.922009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:38.922760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:38.923189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:38.986773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:38.995289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:38.997334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:38.998487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f7cab857-177b-4bae-a76f-d6af5fe76445 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087847 Jul 21 22:52:38.999037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 960/1779] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:39.001194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:39.001839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:39.008697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:39.009177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:39.009944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:39.010382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:39.071127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:39.079716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f014fdea-fc95-4f17-ac96-69827824bddd tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083070 Jul 21 22:52:39.080264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 820/1780] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:38 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:40.015844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:40.016467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:40.023094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:40.023555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:40.024314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:40.024783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:40.087588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:40.096331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:40.096885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:40.097030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:40.097950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:40.099121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9525bacc-5a19-49a5-b140-4aa29327f774 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087434 Jul 21 22:52:40.099678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 961/1781] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:40.103766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:40.104225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:40.105031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:40.105478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:40.170264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:40.178045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a0489b68-297b-4bae-a94b-bd4132bfb783 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085447 Jul 21 22:52:40.178666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 821/1782] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:40 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:41.116896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:41.117490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:41.124705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:41.125151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:41.125898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:41.126329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:41.187729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:41.195176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:41.195795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:41.196299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:41.197844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:41.198993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-87791650-44ef-4b6e-a62e-88554ff412c0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085988 Jul 21 22:52:41.199538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 962/1783] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:41.203286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:41.203823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:41.204739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:41.205240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:41.269964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:41.277591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5237acf7-bf86-4526-975a-de8f10fecc2d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086201 Jul 21 22:52:41.278974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 822/1784] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:41 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:42.218370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:42.219065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:42.225284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:42.225731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:42.226488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:42.226920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:42.287815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:42.294387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:42.295002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:42.296626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:42.298144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:42.299307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-655cbe78-d29c-4762-88d2-9428f6083b39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085570 Jul 21 22:52:42.299856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 963/1785] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:42.302226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:42.302673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:42.303444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:42.303874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:42.367571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:42.376105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ed0420c3-c24a-4b9a-ae4c-960012873753 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085473 Jul 21 22:52:42.376913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 823/1786] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:42 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:43.318219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:43.318827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:43.326113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:43.326561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:43.327321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:43.327756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:43.389843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:43.394459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:43.395069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:43.400626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:43.401567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:43.402009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:43.402148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:43.402767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:43.403698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:43.403957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-301afc7b-8c9c-4e95-acba-927b42e333e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089334 Jul 21 22:52:43.404552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 964/1787] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:43.465946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:43.473413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be987f47-ffa1-4a69-8863-4947497b05c6 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082752 Jul 21 22:52:43.473968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 824/1788] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:43 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:44.422527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:44.423133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:44.425446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=56 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:44.430874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:44.431323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:44.432090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:44.432545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:44.490190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:44.490910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:44.496244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:44.498134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:44.498663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:44.499518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:44.499958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:44.504982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:44.506507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:44.507642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f3fde0c-8d52-4d35-81e8-b58e376ce17f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089205 Jul 21 22:52:44.508457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 965/1789] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:44.561621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:44.568965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d0ac9686-2e9b-4cc8-949f-43a0040d459d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082696 Jul 21 22:52:44.569533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 825/1790] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:44 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:45.526744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:45.527284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:45.533727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:45.534175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:45.534924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:45.535354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:45.586469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:45.587083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:45.593989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:45.594375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:45.595149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:45.595585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:45.596024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:45.598278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:45.606003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:45.607623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:45.608791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-354d9ecb-9068-427d-88b0-3f6d510c83bd tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086062 Jul 21 22:52:45.609346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 966/1791] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:45.660555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:45.668110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-48147e42-5310-4db4-83a0-7e223a62b098 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085532 Jul 21 22:52:45.668697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 826/1792] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:45 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:46.627053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:46.627651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:46.635359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:46.635810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:46.636607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:46.637043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:46.686034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:46.686621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:46.688966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=56 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:46.694505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:46.694961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:46.695750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:46.696198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:46.700459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:46.709750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:46.711260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:46.712417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d5570955-5475-4d95-9c05-8f48b42230ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089514 Jul 21 22:52:46.713007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 967/1793] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:46.758655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:46.766155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aa8e700b-57ea-46f2-8050-3b0e144afca2 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084836 Jul 21 22:52:46.766715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 827/1794] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:46 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:47.730519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:47.731100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:47.737685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:47.738129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:47.738880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:47.739308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:47.783124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:47.783874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:47.790838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:47.791288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:47.792066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:47.792525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:47.801888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:47.811050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:47.812609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:47.813781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0493051c-8e0f-466c-9090-0518c255f529 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087220 Jul 21 22:52:47.814335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 968/1795] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:47.855365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:47.862970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-936af643-3f4b-4422-8d69-94f43b422c3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083981 Jul 21 22:52:47.863653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 828/1796] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:47 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:48.831839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:48.832455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:48.838950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:48.839399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:48.840161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:48.840634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:48.878969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:48.879570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:48.886409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:48.886867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:48.887649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:48.888088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:48.907671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:48.917079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:48.918601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:48.919917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2e7a2663-30e8-45f0-96dd-06649a56ede1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092487 Jul 21 22:52:48.924593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 969/1797] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:48.954556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:48.962198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1d2d496c-861a-4c41-b7fe-00a247802caa tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.087037 Jul 21 22:52:48.962767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 829/1798] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:48 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:49.939900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:49.940525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:49.947053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:49.947510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:49.948271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:49.948729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:49.980509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:49.981149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:49.987724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:49.988184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:49.988984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:49.989422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:50.010142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:50.019683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:50.021238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:50.022400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3e676e83-e766-4ce1-a4b8-cb30b13f5748 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087061 Jul 21 22:52:50.022969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 970/1799] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:50.057304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:50.066101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d8036a8-6fc9-4284-aceb-8bb4161cfbf3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089409 Jul 21 22:52:50.066665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 830/1800] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:49 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:51.040549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:51.041158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:51.048389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:51.048858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:51.049613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:51.050042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:51.083342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:51.083981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:51.090616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:51.091067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:51.091830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:51.092269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:51.113291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:51.121703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:51.123205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:51.124353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0fc14ea0-a39c-42c4-b28b-e78008604e01 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087870 Jul 21 22:52:51.125030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 971/1801] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:51.157390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:51.164954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0a7cfdf1-5b4c-40b9-a743-aa6482219f0a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085406 Jul 21 22:52:51.165569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 831/1802] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:51 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:52.143482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:52.144173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:52.151713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:52.152252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:52.153100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:52.153995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:52.181610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:52.182311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:52.189604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:52.190053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:52.190819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:52.191255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:52.218195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:52.226866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:52.228374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:52.229593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8537e3d-afa7-40a4-ac53-c8861362222c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090751 Jul 21 22:52:52.230156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 972/1803] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:52.253737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:52.255967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:52:52.263017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-56d9e49b-b1f3-4f28-9fee-77e35d04ca39 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085209 Jul 21 22:52:52.263596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 832/1804] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:52 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:53.247422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:53.248547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:53.255033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:53.255475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:53.256227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:53.256698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:53.279545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:53.280872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:53.288145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:53.288630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:53.289432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:53.289870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:53.322226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:53.331366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:53.332920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:53.334087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c1da256-6d49-4c1a-b626-617a5e1c783e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090631 Jul 21 22:52:53.334656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 973/1805] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:53.354509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:53.362303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4f46cb80-e1f4-4a66-b265-ba32a8de171f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086651 Jul 21 22:52:53.362863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 833/1806] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:53 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:52:54.352751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:54.353438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:54.360742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:54.361188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:54.361958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:54.362395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:54.379702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:54.380981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:54.387528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:54.387987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:54.388794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:54.389320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:54.432057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:54.445555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:54.447098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:54.448239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-50cd15e8-7b14-48e6-9b8d-45e7b7878650 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.099621 Jul 21 22:52:54.448833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 974/1807] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:54.457667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:54.465263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8e85d1cd-621e-43ad-bf50-c4ca510363de tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.089753 Jul 21 22:52:54.465826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 834/1808] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:54 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:55.466593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:55.467874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:55.474669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:55.475111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:55.475874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:55.476299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:55.482584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:55.483206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:55.489980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:55.490435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:55.491222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:55.491673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:55.539610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:55.550084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:55.551646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:55.552833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2dbeb272-0fe6-4b72-b46b-f0f8f1415c46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090191 Jul 21 22:52:55.553626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 975/1809] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:55.573130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:55.581519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1503a437-753f-44c0-be05-56df886a163f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.102706 Jul 21 22:52:55.582093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 835/1810] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:55 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:56.571659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:56.572268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:56.579372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:56.579821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:56.580614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:56.581054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:56.598892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:56.599590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:56.606067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:56.606509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:56.607263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:56.607689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:56.642488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:56.651234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:56.652833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:56.653998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-877e196c-31e5-4d22-96cc-241789fe58df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086265 Jul 21 22:52:56.656053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 976/1811] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:56.672535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:56.680276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd66ae48-0a2f-4319-bfd6-112ffdbf4c0d tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085165 Jul 21 22:52:56.680894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 836/1812] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:56 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:57.673679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:57.674279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:57.680762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:57.681206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:57.681963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:57.682392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:57.697572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:57.698328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:57.705408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:57.705857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:57.706630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:57.707063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:57.748456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:57.769720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:57.772450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:57.774599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-91b302cb-e8df-46d3-9eb1-ba709264e37c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.105170 Jul 21 22:52:57.775616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 977/1813] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:57.786900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:57.794559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89ac21a7-86cc-48c9-ae63-c231c52046a5 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.100903 Jul 21 22:52:57.795112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 837/1814] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:57 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:58.792629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:58.793226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:58.800211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:58.800705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:58.801604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:58.802041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:58.811525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:58.812327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:58.818373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:58.818818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:58.819601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:58.820388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:58.871382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:58.881005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:58.882679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:58.885388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9dae268c-3aa6-4aba-b7a3-5f28a6fd3a78 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095532 Jul 21 22:52:58.886072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 978/1815] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:58.897766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:58.902863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4cff026d-d935-48cd-9075-87b9ae93385b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.095601 Jul 21 22:52:58.903465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 838/1816] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:58 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:52:59.906548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:59.907164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:59.913748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:59.914204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:59.914969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:59.915407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:59.920302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:52:59.921636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:52:59.928291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:59.928786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:59.929549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:52:59.929983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:52:59.977053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:59.986639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:59.988163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:52:59.989367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-31a1d2a7-6669-44b2-8f21-32b3b7b374f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087537 Jul 21 22:52:59.990157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 979/1817] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:52:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:52:59.992782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:00.001151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-baf3e039-cb11-49fc-8cf0-ec0788877c9a tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084676 Jul 21 22:53:00.001713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 839/1818] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:52:59 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:01.007471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:01.008360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:01.015096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:01.015543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:01.016301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:01.016749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:01.017457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:01.018100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:01.024497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:01.024951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:01.025714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:01.026151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:01.084392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:01.089020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:01.093306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:01.094930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:01.096096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f07e7ed7-d03f-4a50-a651-39e725c8017d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092460 Jul 21 22:53:01.096702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 980/1819] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:01.097044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-015edda0-708a-4c2e-bc89-53aef6f8cc3c tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083221 Jul 21 22:53:01.097814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 840/1820] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:01 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:53:02.114004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:02.114567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:02.114929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:02.115055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:02.121118 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:02.121264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:02.121564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:02.121678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:02.122322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:02.122439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:02.122753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:02.122873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:02.189287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:02.189440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:02.197048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8a3566ae-4e17-4ddb-8d23-c87525378eff tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.086884 Jul 21 22:53:02.197618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 841/1821] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:02 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:02.198080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:02.199611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:02.200790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7fe0c3f9-b51c-4739-a010-a5300820eda3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090657 Jul 21 22:53:02.201343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 981/1822] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:03.214657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:03.215293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:03.219305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:03.219917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:03.221789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:03.222230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:03.223001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:03.223429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:03.226409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:03.226860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:03.227627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:03.228061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:03.286687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:03.289568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:03.294273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dfbad440-1037-4368-a609-d2ae70dc5760 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.083435 Jul 21 22:53:03.294837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 842/1823] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:03 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:03.298847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:03.300371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:03.301617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-03bf0d6a-2ec9-4a14-9af1-22ad96ac0c59 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086550 Jul 21 22:53:03.302131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 982/1824] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:04.313508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:04.314102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:04.320618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:04.321064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:04.321824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:04.322255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:04.324472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:04.325113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:04.332186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:04.332678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:04.333452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:04.333894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:04.349838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:04.389055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:04.397806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ef899660-7ad3-4be9-9c5f-d773ab6fe338 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.088777 Jul 21 22:53:04.398821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 843/1825] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:04 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:04.401095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:04.409788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:04.411299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:04.412445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-730f85b2-7468-4518-99f4-76e2f8ef1858 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091854 Jul 21 22:53:04.413039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 983/1826] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:05.414929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:05.415542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:05.422619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:05.423073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:05.423841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:05.424281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:05.430525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:05.431140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:05.438556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:05.439104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:05.439891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:05.440329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:05.488122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:05.495651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e397462c-4a4d-4660-aa08-c98476e71dc3 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.084584 Jul 21 22:53:05.496215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 844/1827] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:05 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:05.505780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:05.515185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:05.516735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:05.517880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-26407ed8-7e1c-4aae-9ff9-31a39582680c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091402 Jul 21 22:53:05.518435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 984/1828] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:06.513231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:06.513839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:06.521112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:06.521664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:06.522588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:06.523177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:06.539490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:06.540608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:06.551068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:06.551926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:06.553200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:06.553918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:06.604782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:06.612947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-73a2f60e-9005-45c0-acee-6b018b61f201 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.103525 Jul 21 22:53:06.613524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 845/1829] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:06 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:06.625429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:06.634171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:06.635672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:06.636832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78b5dd33-a8bf-4872-97a6-f68b7445d4fb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.104138 Jul 21 22:53:06.637383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 985/1830] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:07.630347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:07.630952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:07.637878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:07.638325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:07.639090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:07.639564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:07.654287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:07.654892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:07.661561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:07.662756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:07.662756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:07.663200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:07.703723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:07.711553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7ddec647-ba53-4762-ae3f-44e4326a753f tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.085081 Jul 21 22:53:07.712137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 846/1831] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:07 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:07.725978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:07.735340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:07.736884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:07.738031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3d3b6383-f798-4eee-aa3a-ce395441692c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087563 Jul 21 22:53:07.738585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 986/1832] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:08.729668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:08.730238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:08.736665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:08.737119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:08.737880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:08.738317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:08.755725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:08.756333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:08.763113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:08.763559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:08.764320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:08.765630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:08.800231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:08.807816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5591f96e-2af6-48a5-8114-9643e5249614 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082056 Jul 21 22:53:08.808759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 847/1833] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:08 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:08.830231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:08.838618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:08.840142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:08.841303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5259a06-1d99-44c8-b84c-782b8b3327d8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089414 Jul 21 22:53:08.841855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 987/1834] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:09.825385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:09.825999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:09.833159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:09.833613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:09.834380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:09.834818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:09.859829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:09.860437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:09.866947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:09.867397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:09.868165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:09.868623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:09.903189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:09.913965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee08a557-5900-43ee-bf5c-369f92428bbe tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.092343 Jul 21 22:53:09.914673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 848/1835] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:09 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:10.097533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:10.105936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:10.107433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:10.109160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc9c25f0-73f1-409d-a727-5ea893b22b41 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.253299 Jul 21 22:53:10.109728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 988/1836] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:10.932703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:10.933312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:10.940791 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:10.941244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:10.942040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:10.942471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:10.958140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:11.011990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:11.019705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-10e0ba20-2624-41b9-969c-cc18deab0a01 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.091079 Jul 21 22:53:11.020257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 849/1837] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:10 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:11.127114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:11.127715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:11.134581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:11.135025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:11.135779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:11.136222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:11.200018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:11.208714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:11.210229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:11.211372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-01b1d523-7f66-464d-959d-b36ff9264694 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088275 Jul 21 22:53:11.211925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 989/1838] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:12.036409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:12.037208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:12.043681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:12.044126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:12.044916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:12.045386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:12.105144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:12.113411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9272797e-fc48-42cb-b8ba-dfca1314403b tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.080820 Jul 21 22:53:12.113974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 850/1839] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:12 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:12.229794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:12.230400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:12.237461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:12.237906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:12.238663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:12.239090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:12.301189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:12.309615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:12.311114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:12.313434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-358870bc-87e2-492e-8f2f-94aa2bc8d121 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087525 Jul 21 22:53:12.313985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 990/1840] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:13.130907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:13.131522 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:13.138406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:13.138857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:13.140107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:13.140107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:13.201997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:13.209579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc4ab89e-f160-40c2-9e6a-3dfbbe952305 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.082641 Jul 21 22:53:13.210149 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 851/1841] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:13 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:13.331207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:13.331855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:13.338320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:13.338764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:13.339527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:13.339941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:13.400337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:13.409269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:13.410758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:13.411889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-18683e15-38a9-40eb-bc5c-54a0a2a9deb1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084647 Jul 21 22:53:13.412429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 991/1842] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:14.226632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:14.227234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] [instance: 7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:14.234362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:14.234806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:14.235560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:14.235993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:14.296887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68f8c3b4d761425db457093edfccce6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '671dbc43a5c04a26b23e278f3f7964bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:14.304699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9b492939-7867-48f9-9029-42e2cccf0733 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9" status: 200 len: 1213 microversion: 2.1 time: 0.081874 Jul 21 22:53:14.305267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 852/1843] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:53:14 2022] GET /compute/v2.1/servers/7bbf9245-6f64-4abb-b4f9-dc1b163cc8d9 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:53:14.430525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:14.431203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:14.434032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=54 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:14.439124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:14.439608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:14.440393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:14.440850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:14.482957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-33d8352e-7c30-404e-951a-125baac90b79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] Calling method '.version_select at 0x7ff1db1ebdc0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:14.501243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-33d8352e-7c30-404e-951a-125baac90b79 tempest-TestShelveInstance-715157894 tempest-TestShelveInstance-715157894-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2145590754" status: 202 len: 0 microversion: 2.1 time: 0.022187 Jul 21 22:53:14.501885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 853/1844] 10.222.0.42 () {58 vars in 1253 bytes} [Thu Jul 21 22:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2145590754 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:53:14.515402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:14.524274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:14.526791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:14.527951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d69313c5-8162-40a1-9d14-38be9b7a372f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.101409 Jul 21 22:53:14.529102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 992/1845] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:15.546283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:15.546887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:15.553369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:15.553822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:15.554585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:15.555017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:15.640580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:15.649355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:15.650844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:15.651989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3ad0a8bb-0b36-413b-a30e-075eaf93f5ce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.109790 Jul 21 22:53:15.652754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 854/1846] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:16.671803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:16.673167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:16.681461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:16.682154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:16.683117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:16.683708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:16.750172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:16.759676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:16.761378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:16.762529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92976f59-5c73-41e1-bba5-fb787ed0f124 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095354 Jul 21 22:53:16.763311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 993/1847] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:17.782671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:17.783988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:17.788002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:17.793031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:17.793706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:17.794642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:17.795408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:17.875891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:17.885270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:17.887306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:17.888122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b00adddc-f66a-44e1-94cb-4b088da7c7e7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.110546 Jul 21 22:53:17.888708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 855/1848] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:18.909298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:18.910080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:18.917919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:18.918454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:18.919460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:18.919800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:19.227373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:19.237016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:19.239025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:19.240498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-edf32e17-7a03-4bf7-a7bf-cf92c9c3dce0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.336905 Jul 21 22:53:19.241268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 994/1849] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:20.259405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:20.260018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:20.266944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:20.267389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:20.268354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:20.268820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:20.337610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:20.347344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:20.349015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:20.350370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b5a54cb5-125a-4d26-bae1-8450b191cff6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095037 Jul 21 22:53:20.351051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 856/1850] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:21.371781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:21.372357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:21.383244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:21.384367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:21.384526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:21.384924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:21.463032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:21.472557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:21.474237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:21.475484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46ab46ed-9fac-4283-a01a-a2c584edece3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.110277 Jul 21 22:53:21.476029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 995/1851] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:22.495064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:22.495747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:22.503132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:22.503578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:22.504359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:22.504815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:22.572109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:22.580840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:22.582352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:22.583487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1496c571-157b-4b16-99db-c14d3b5f49a1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092555 Jul 21 22:53:22.584039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 857/1852] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:23.601443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:23.602080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:23.608977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:23.609429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:23.610189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:23.610625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:23.671279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:23.679721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:23.681258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:23.682400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f30be49-e1a2-466a-89bc-a5ac31d30098 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084967 Jul 21 22:53:23.682956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 996/1853] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:24.701378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:24.702699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:24.708917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:24.709384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:24.710143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:24.710567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:24.776018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:24.785261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:24.786783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:24.787925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-483cf9b2-1120-4d2f-b2eb-a618605594a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090575 Jul 21 22:53:24.788472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 858/1854] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:25.806466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:25.807069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:25.813902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:25.814351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:25.815110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:25.815543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:25.877814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:25.886492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:25.888000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:25.889894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e61844e0-4f92-4f96-a736-cd5e3503ed7e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086728 Jul 21 22:53:25.890463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 997/1855] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:26.908516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:26.909133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:26.915099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:26.915545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:26.916307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:26.916764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:26.979479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:26.987899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:26.989428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:26.990564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1339629b-fd2d-4afc-a3ba-a219c3f2594a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087302 Jul 21 22:53:26.991120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 859/1856] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:28.009616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:28.010264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:28.017561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:28.018019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:28.018787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:28.019220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:28.089763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:28.098392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:28.099900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:28.101067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6c368d3-e773-4263-8e62-da219e2e50d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095648 Jul 21 22:53:28.101614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 998/1857] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:29.119321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:29.119950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:29.126843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:29.127319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:29.128082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:29.128540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:29.190671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:29.198976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:29.200503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:29.201663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-19129fc0-261b-4e73-9446-2b7b4ff31c16 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086279 Jul 21 22:53:29.202226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 860/1858] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:30.219737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:30.220420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:30.226964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:30.227415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:30.228178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:30.228651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:30.291002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:30.300632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:30.302144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:30.303301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eb2a9a38-4693-4aff-a6f8-e35230de6e55 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087729 Jul 21 22:53:30.303852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 999/1859] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:31.321852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:31.322448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:31.329622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.330070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.330835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:31.331274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:31.393052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:31.401848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:31.403383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:31.404578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f82fd29-c81f-4e9a-8dbf-8983a74a5a1b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086666 Jul 21 22:53:31.405152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 861/1860] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:32.422167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:32.422767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:32.430450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:32.430887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:32.431664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:32.432104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:32.434819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:32.496891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:32.505253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:32.506756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:32.508146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-505693ce-6ba1-4cbd-ae4f-2d5587472c26 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089758 Jul 21 22:53:32.508733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1000/1861] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:33.526690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:33.527201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:33.534307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:33.534750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:33.535501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:33.535930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:33.600701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:33.609707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:33.611219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:33.612360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-096ace85-dd4f-4537-8d88-884be80751cc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089645 Jul 21 22:53:33.612946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 862/1862] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:34.630971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:34.631604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:34.638386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.638840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:34.639603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:34.640088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:34.703766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:34.712427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:34.713969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:34.715125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9dc2db2a-da77-43b8-9b21-bbf72c905134 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088142 Jul 21 22:53:34.715684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1001/1863] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:35.733321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:35.735104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:35.741417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:35.741868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:35.742638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:35.743077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:35.807245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:35.815838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:35.817378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:35.818524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6bc8cd04-4818-4d34-a31c-07fb1556b2a5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089169 Jul 21 22:53:35.819076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 863/1864] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:36.836427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:36.837075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:36.844026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:36.844495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:36.845279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:36.845715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:36.907981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:36.916374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:36.917903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:36.919049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b78deee-eae9-4b14-8396-b9e47af8c20d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086563 Jul 21 22:53:36.919604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1002/1865] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:37.937746 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:37.938332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:37.944958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.945397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:37.946151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:37.946589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:38.009029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:38.017428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:38.018934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:38.020077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ae44ac24-3929-424c-a3d7-2a0399012415 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086450 Jul 21 22:53:38.020665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 864/1866] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:53:39.038659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:39.039268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:39.045745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:39.046863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:39.047741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:39.048176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:39.109676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.118070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.119577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:39.120812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aa942b6f-4cc2-4914-bfbf-955254b2ad3e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086089 Jul 21 22:53:39.121363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1003/1867] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:40.139544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:40.140143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:40.147388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.147833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.148626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:40.149109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:40.210254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.218630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.220167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:40.221336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3d1f2396-49cb-4f60-8a3d-cfd5c96ff864 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085717 Jul 21 22:53:40.221894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 865/1868] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:41.239039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:41.239749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:41.246237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:41.246668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:41.247423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:41.247853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:41.310132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:41.319088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:41.320621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:41.321760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8369483e-128f-4cd3-8295-186334dbadb9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086672 Jul 21 22:53:41.322308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1004/1869] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:42.340650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:42.341267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:42.348591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.349042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.349811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:42.350256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:42.354159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=94 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:42.417156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:42.426985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:42.428750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:42.429900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c359417a-7044-4071-b234-8a7e02dc9ab8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093247 Jul 21 22:53:42.430459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 866/1870] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:43.448506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:43.449157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:43.456136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.456627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.457404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:43.457850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:43.524745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.534157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.535669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:43.536866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8c9b6eb5-665d-435d-987b-d23ef746b68a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092344 Jul 21 22:53:43.537431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1005/1871] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:44.554619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:44.555226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:44.561713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.562159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.562912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:44.563957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:44.625727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.634310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.635813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:44.636978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18d39343-e554-4eb1-92fe-86083db4ef76 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086380 Jul 21 22:53:44.637551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 867/1872] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:45.654886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:45.655497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:45.658144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=28 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:45.667951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.668404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.669243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:45.669661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:45.732541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:45.742278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:45.743794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:45.744973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-801df497-6821-47e0-8e4d-94b9914fd857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094082 Jul 21 22:53:45.745535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1006/1873] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:46.764174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:46.764762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:46.771762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.772208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.773003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:46.773435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:46.834848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.843193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.845399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:46.846558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f6c6bf47-a0d6-4594-b56b-f2d5e0fa24c3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086323 Jul 21 22:53:46.847117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 868/1874] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:47.865541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:47.866127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:47.872121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.872604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.873364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:47.873797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:47.936401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.945195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.946704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:47.947856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cbf24c1c-f86e-4460-a147-61c0b05a2c39 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087458 Jul 21 22:53:47.948443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1007/1875] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:48.966585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:48.967199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:48.969613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=28 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:53:48.975400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.975877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:48.976773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:48.977230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:49.043053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.052266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.053808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:49.054950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9a95e29b-a99d-4a20-8710-6aa2268967aa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092315 Jul 21 22:53:49.055510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 869/1876] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:50.073623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:50.074235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:50.081787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.082242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.083010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:50.083455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:50.145626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.154048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.155562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:50.156763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9e7c428-cc08-432c-b384-0b7c0999e792 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087165 Jul 21 22:53:50.157391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1008/1877] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:51.175167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:51.175780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:51.182340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.182802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.183584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:51.184030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:51.252426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.261280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.262824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:51.263973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f5057c2d-562f-4616-8e20-bef648b45b37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093176 Jul 21 22:53:51.264546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 870/1878] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:52.283005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:52.283673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:52.290085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.290519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.291271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:52.291699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:52.358568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.367574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.369103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:52.370237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3bac26a4-0b5e-4e7e-a261-78f08a545cdc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091765 Jul 21 22:53:52.370795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1009/1879] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:53.389339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:53.389981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:53.396173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.396671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.397455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:53.397887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:53.461645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.470100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.471735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:53.472906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1844f243-964e-4a9d-975d-bfcc3fb9dea7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087662 Jul 21 22:53:53.473463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 871/1880] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:54.491477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:54.492104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:54.498680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.499127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.499882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:54.500315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:54.562040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.571641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.573180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:54.574321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d4760c6-29dd-4acf-8e1d-ad028d1439ef tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086843 Jul 21 22:53:54.574871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1010/1881] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:55.592912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:55.593525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:55.601179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.601630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.602398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:55.602836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:55.672128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.680987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.682495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:55.683629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b12e2767-1801-41e2-81fd-65c00a742f7a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094670 Jul 21 22:53:55.684183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 872/1882] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:56.701993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:56.702544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:56.709979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.710427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.711192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:56.711626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:56.774677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.784371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.785892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:56.787040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2fb21346-797a-447e-829a-48cab4941536 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089134 Jul 21 22:53:56.787594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1011/1883] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:57.806421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:57.807117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:57.814466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.814881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.815660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:57.816098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:57.880744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.889696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.891232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:57.892394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-94630c23-932f-4a69-9c71-1b6d0c145eeb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090084 Jul 21 22:53:57.892994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 873/1884] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:53:58.910415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:53:58.911029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:53:58.917791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.918237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.919000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:53:58.919428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:53:58.981209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:58.990067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:58.991689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:53:58.992899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2bb837da-4752-40ba-999c-8b8ed5e250c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086514 Jul 21 22:53:58.993458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1012/1885] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:53:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:00.012107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:00.012762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:00.019781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.020230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.021022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:00.021460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:00.087843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.096735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.098259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:00.099412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f6c705cd-d305-4a51-8075-41cfda0fe78a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091539 Jul 21 22:54:00.099974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 874/1886] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:01.126943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:01.127558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:01.134677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.135192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.135961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:01.136392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:01.209386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.219074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.221278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:01.222445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dda29015-4a73-4dc4-a7d0-1163fc9fe05c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.099486 Jul 21 22:54:01.223004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1013/1887] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:02.240517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:02.241117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:02.247631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.248079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.248872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:02.249305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:02.315796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.324915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.326428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:02.327580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5ddd3fa2-4f0e-4aa5-a85c-c09c90fe4dde tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091083 Jul 21 22:54:02.328129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 875/1888] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:03.346735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:03.347342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:03.354892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.355372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.356176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:03.356673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:03.359512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:03.423132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.431698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.433232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:03.434382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7dbaf3ed-16fe-4b3e-9c10-f60273c13873 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092477 Jul 21 22:54:03.434935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1014/1889] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:04.451241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:04.451852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:04.459429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.459883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.460683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:04.461120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:04.523668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:04.533291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:04.534863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:04.536022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2bcbf045-7a67-44f5-9380-bdca0ce93b90 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088758 Jul 21 22:54:04.536595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 876/1890] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:05.553670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:05.554283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:05.560866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.561314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.562071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:05.562504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:05.623561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.632499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.634286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:05.635424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70e4f019-bb37-49e5-b445-655c8d492b8f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085662 Jul 21 22:54:05.635973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1015/1891] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:06.653908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:06.654519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:06.661260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.661711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.662485 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:06.662925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:06.727213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.736279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.737853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:06.739014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b6a09c81-efa0-4f9e-ad4a-b51f43cf9b30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089040 Jul 21 22:54:06.739576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 877/1892] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:07.758196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:07.758831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:07.765471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.765918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.766877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:07.767555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:07.798948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:54:07.799346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:54:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 (ip 10.222.0.42) !!! Jul 21 22:54:07.829956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.838292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.839777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:07.840954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1a949370-3e32-4ef2-a755-3d7eb51f97fa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086966 Jul 21 22:54:07.841504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1016/1893] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:08.859504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:08.860857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:08.867319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.867764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.868547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:08.868975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:08.935399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.944151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.945695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:08.946831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0706b363-c547-415b-8f63-5860e0ad4acb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091337 Jul 21 22:54:08.947387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 878/1894] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:09.964780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:09.965385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:09.972081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.972544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:09.973308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:09.973743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:10.038417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:10.046803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:10.048887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:10.050035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-542a52e5-7ae6-4f1b-81dc-405e3f3a5ae0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089304 Jul 21 22:54:10.050594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1017/1895] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:11.070112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:11.071358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:11.078681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:11.080166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:11.081034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:11.081474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:11.151839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.160847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.162378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:11.163673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5d7fa362-fad4-4321-87c8-3a5e7458285c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.100073 Jul 21 22:54:11.164237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 879/1896] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:12.182282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:12.182885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:12.190195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.190644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.191408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:12.191842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:12.255498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.264107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.265666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:12.267886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-66b7dee0-5624-479d-b20e-0000aa55a74b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088702 Jul 21 22:54:12.268447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1018/1897] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:13.286041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:13.286659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:13.293315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.293770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.294541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:13.294983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:13.298918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=84 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:13.356424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:13.365088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:13.366602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:13.367745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-92de0770-1be2-40bc-8e9d-1bdf49933339 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085666 Jul 21 22:54:13.368339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 880/1898] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:14.642475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:14.643030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:14.649047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.649498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.650268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:14.650702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:14.712790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:14.721631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:14.723169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:14.724351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-88b482c5-fcb1-4eeb-a9d7-6a2d19b9a672 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.342804 Jul 21 22:54:14.724954 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1019/1899] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:15.742276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:15.742825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:15.749295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:15.749739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:15.750498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:15.750950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:15.930343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:15.939464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:15.941020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:15.942171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d17254c4-9b32-441a-9388-db1e383fffc3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.203912 Jul 21 22:54:15.942723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 881/1900] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:16.961146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:16.961753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:16.964147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=28 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:16.969565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:16.970266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:16.970768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:16.971199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:17.086737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:17.095119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:17.096648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:17.097792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12d75b40-b509-48cb-804d-a309eb54f182 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.140785 Jul 21 22:54:17.098346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1020/1901] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:18.115966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:18.116613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:18.123153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:18.123599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:18.124361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:18.124825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:18.191054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:18.199464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:18.201020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:18.202180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63a7616e-2318-4a1b-b8f1-e8f02f2bebaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090133 Jul 21 22:54:18.202736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 882/1902] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:19.221658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:19.222217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:19.228840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:19.229296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:19.230115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:19.230557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:19.303366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:19.315113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:19.316654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:19.317808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1c748e3f-87b4-4a46-b4a5-b237741b134f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.100305 Jul 21 22:54:19.318366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1021/1903] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:20.336212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:20.336852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:20.339163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=28 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:20.345322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:20.345782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:20.346559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:20.346995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:20.413884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:20.422590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:20.424249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:20.425422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7fc6de6-383d-453e-9dfb-998a094cbf70 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093121 Jul 21 22:54:20.425976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 883/1904] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:21.443384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:21.444001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:21.450894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:21.451336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:21.452222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:21.452687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:21.514048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:21.522725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:21.524227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:21.525406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3b79dad8-cbfe-4479-827a-49b5c548a98a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085990 Jul 21 22:54:21.525965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1022/1905] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:22.543883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:22.544512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:22.551234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:22.551710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:22.552459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:22.552920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:22.614341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:22.622676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:22.624167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:22.625334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9e57d162-da79-4a39-873e-67130ca2b857 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085398 Jul 21 22:54:22.626671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 884/1906] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:23.644075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:23.644719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:23.651215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.651667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.652427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:23.652887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:23.720045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:23.728606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:23.730119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:23.731281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cdffb9ca-374a-42be-a325-c7ad511cb21b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091233 Jul 21 22:54:23.731821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1023/1907] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:24.749282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:24.749877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:24.757411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:24.758116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:24.758880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:24.759313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:24.820210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:24.828854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:24.830919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:24.832279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-074a91f5-e701-4b4b-9780-8757063af798 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086971 Jul 21 22:54:24.832864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 885/1908] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:25.851137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:25.851750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:25.858205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.858650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:25.859413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:25.859846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:25.921203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:25.930762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:25.932270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:25.933454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9c4fc02-424b-49ae-8d9c-7d0ec9526c37 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087428 Jul 21 22:54:25.934009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1024/1909] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:26.951677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:26.952274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:26.959613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:26.960073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:26.960871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:26.961321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:27.027107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:27.036215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:27.037752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:27.038905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ebe880e4-c058-47f3-89e1-5ccc8c117c9b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091187 Jul 21 22:54:27.039451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 886/1910] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:28.057229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:28.057838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:28.064639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.065092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.065854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:28.066291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:28.133131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:28.141575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:28.143802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:28.144977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6dea9cff-8390-457c-928f-f174fddafcb3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091896 Jul 21 22:54:28.145531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1025/1911] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:29.163598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:29.164239 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:29.170827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.171280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.172042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:29.172492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:29.234687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:29.244156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:29.245729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:29.246888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e5dfff2-a74f-48e4-a2d5-1366224fe89c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087202 Jul 21 22:54:29.247444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 887/1912] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:30.264801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:30.265354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:30.272313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.272797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:30.273710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:30.274150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:30.336325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:30.344761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:30.346965 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:30.348112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2ff026bb-da5c-4f1d-aaca-bc932e1313df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087362 Jul 21 22:54:30.348696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1026/1913] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:31.366197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:31.366797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:31.373302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:31.373753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:31.374576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:31.375011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:31.438357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:31.447421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:31.448939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:31.450073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15ad9389-5391-4e59-84dc-6c653c695d61 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087770 Jul 21 22:54:31.450627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 888/1914] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:32.468269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:32.468926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:32.475878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:32.476322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:32.477117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:32.477545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:32.540436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:32.549463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:32.550970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:32.552100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1423a79a-6edb-4460-b844-de248ac52318 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087803 Jul 21 22:54:32.552691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1027/1915] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:33.570432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:33.571063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:33.577675 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.578256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.579121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:33.579559 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:33.641189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:33.650036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:33.651557 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:33.652748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6685b7c1-ecb6-4815-b9fc-4038d3fc0a08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086277 Jul 21 22:54:33.653312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 889/1916] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:34.670502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:34.671105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:34.678087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.678566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.679501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:34.679921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:34.683995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:34.741483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:34.749819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:34.751325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:34.753106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-85f23090-b6b8-4f22-a962-8204dc94a75d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086488 Jul 21 22:54:34.753655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1028/1917] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:35.772162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:35.772797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:35.779552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:35.780029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:35.780826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:35.781291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:35.847131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:35.855620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:35.857158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:35.858297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bc7196ff-126d-448b-a870-2893a42517ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090063 Jul 21 22:54:35.858839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 890/1918] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:35.904980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:54:35.905482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:54:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:54:36.876679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:36.877295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:36.883950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:36.884392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:36.885168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:36.885595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:36.948793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:36.957446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:36.958968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:36.960100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-756c06d8-f257-4fb8-bb6a-4c5ca8c4bfaa tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087395 Jul 21 22:54:36.960677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1029/1919] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:37.977759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:37.978417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:37.984902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:37.985349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:37.986174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:37.986691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:38.048699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:38.057439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:38.058966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:38.060124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dd68cdb6-9bb2-4768-ba24-d3759548399b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086283 Jul 21 22:54:38.060712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 891/1920] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:39.078123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:39.078732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:39.086288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:39.086732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:39.087498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:39.087928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:39.149766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:39.158282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:39.159839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:39.161011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be05931d-8dfc-4939-8ebd-7923f6f24724 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086843 Jul 21 22:54:39.161556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1030/1921] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:40.178975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:40.179584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:40.186309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:40.186758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:40.187511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:40.187940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:40.249956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:40.259141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:40.260683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:40.261828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9e75291f-d75c-4c8a-abfe-8bbe067f0c0d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086927 Jul 21 22:54:40.262385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 892/1922] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:41.280234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:41.280857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:41.287760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:41.288197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:41.288979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:41.289409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:41.350590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:41.358928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:41.360431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:41.361589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d12785bc-0421-432f-b7d3-84e05a4c2b7b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085257 Jul 21 22:54:41.362136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1031/1923] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:42.381085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:42.381691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:42.389190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:42.389863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:42.390866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:42.391475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:42.461161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:42.469960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:42.471463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:42.472811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-50f28406-3d16-4b70-934f-8a5f33c123fc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.096184 Jul 21 22:54:42.473367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 893/1924] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:43.491024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:43.491626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:43.497724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:43.498175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:43.498938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:43.499379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:43.559809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:43.568847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:43.570366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:43.571518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-12aa4896-508d-469e-b9f4-ed7c1de8f2ed tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084740 Jul 21 22:54:43.572073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1032/1925] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:44.590489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:44.591090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:44.598245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:44.598686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:44.599440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:44.599870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:44.603741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=84 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:44.665947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:44.674371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:44.675940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:44.677105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c10ae17e-9f7c-471a-82f0-da1260e109f3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090580 Jul 21 22:54:44.677657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 894/1926] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:45.694990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:45.695597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:45.702239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:45.702687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:45.703454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:45.703904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:45.768722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:45.777271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:45.778776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:45.779916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d3267546-1364-4f17-b4eb-d102ee3423df tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088920 Jul 21 22:54:45.780464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1033/1927] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:45 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:46.798072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:46.798702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:46.805787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:46.806267 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:46.807004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:46.807432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:46.869172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:46.877639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:46.879801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:46.880980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ed9b613d-2035-4b2a-961f-3042992ce9b2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086829 Jul 21 22:54:46.881568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 895/1928] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:47.899764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:47.900394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:47.902684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=28 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:47.907956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:47.908399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:47.909207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:47.909633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:47.972835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:47.981374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:47.982890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:47.984031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7fcfa702-cd0c-44b3-8e99-5429ee170448 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088170 Jul 21 22:54:47.984596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1034/1929] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:49.002138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:49.002744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:49.009787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:49.010265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:49.011171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:49.011604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:49.075867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:49.084811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:49.086320 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:49.087452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4e9d6cea-a5ea-45b0-b76a-923f649a3267 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089247 Jul 21 22:54:49.088002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 896/1930] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:50.106601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:50.107306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:50.113876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:50.114326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:50.115895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:50.116242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:50.178793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:50.187211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:50.188756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:50.189916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5b03e714-45cc-46a0-9639-024831cedc15 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087240 Jul 21 22:54:50.190479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1035/1931] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:51.208385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:51.209433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:51.211728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=28 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:54:51.217137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:51.217587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:51.218352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:51.218783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:51.282959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:51.291533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:51.293164 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:51.294225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0b168ac3-3b05-470d-bc03-0e3d28def8f4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089903 Jul 21 22:54:51.294777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 897/1932] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:52.312419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:52.313093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:52.320989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:52.321443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:52.322225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:52.322665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:52.384563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:52.393738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:52.395359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:52.397120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5906ddac-4af4-4b0d-89a4-ab6755f70526 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089067 Jul 21 22:54:52.397676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1036/1933] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:54:53.415800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:53.416436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:53.422695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:53.423147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:53.423918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:53.424359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:53.492207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:53.500659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:53.502185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:53.503335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-884a6e90-1ef3-4cac-82b6-09ad3fecf2ec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092117 Jul 21 22:54:53.503894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 898/1934] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:54.522129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:54.522763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:54.529282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:54.529727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:54.530480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:54.530914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:54.595586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:54.604890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:54.606337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:54.607469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-34bd53fa-10b0-44ff-8e85-fa01b9e49e81 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089314 Jul 21 22:54:54.608047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1037/1935] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:55.626894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:55.627498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:55.634854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:55.635296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:55.636053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:55.636500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:55.699229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:55.707858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:55.709541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:55.710708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7e0274c4-c241-48b6-8dc2-b84fe5698df2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087690 Jul 21 22:54:55.711268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 899/1936] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:56.729623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:56.730169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:56.737522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:56.737971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:56.738739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:56.739214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:56.801835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:56.810311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:56.811819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:56.813003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-88d612b3-f529-4606-b168-76b0d312ef2e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087438 Jul 21 22:54:56.813547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1038/1937] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:56 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:57.831184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:57.831870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:57.839151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:57.839603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:57.840364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:57.840833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:57.904018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:57.913208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:57.914712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:57.915854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-26f895aa-9225-4c77-8327-892a24dd7fec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088595 Jul 21 22:54:57.916405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 900/1938] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:54:58.933348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:54:58.933941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:54:58.940499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:58.941000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:58.941759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:54:58.942196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:54:59.003986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:59.012836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:59.014361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:54:59.015499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f1fb253-bef5-470d-8776-19a740ced84f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086066 Jul 21 22:54:59.016053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1039/1939] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:54:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:00.034044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:00.034708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:00.041924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.042406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.043175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:00.043612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:00.108584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:00.118344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:00.119889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:00.121074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5dd06589-fa6f-4145-86ae-e1ae75e72e1c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090918 Jul 21 22:55:00.121640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 901/1940] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:01.139640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:01.148816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:01.151037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:01.151644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:01.152313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:01.153531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:01.214134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:01.222488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:01.224596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:01.225945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-06f624e7-029d-4517-9414-e5b0d9eaf43c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090362 Jul 21 22:55:01.226499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1040/1941] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:02.244741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:02.245344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:02.251842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:02.252292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:02.253104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:02.253543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:02.318274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:02.326643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:02.328153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:02.329312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e092e9c2-732c-493c-b528-79f685b2505f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088612 Jul 21 22:55:02.329867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 902/1942] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:03.347165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:03.347773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:03.354917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.355369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.356128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:03.356746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:03.423618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:03.432397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:03.433905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:03.435042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-761ffdf3-a866-48c6-b755-cce93d6dd168 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091791 Jul 21 22:55:03.435589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1041/1943] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:04.452162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:04.452795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:04.459539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.459985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.460778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:04.461212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:04.524035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:04.532681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:04.534191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:04.535344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aae7948c-9375-4d84-b3b2-0ceec26ff0ba tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087076 Jul 21 22:55:04.536801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 903/1944] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:05.554406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:05.555007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:05.561721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:05.562184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:05.562912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:05.563366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:05.567289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=84 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:05.830734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:05.839833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:05.841366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:05.842503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-135028ab-7876-480a-b47e-c51ffa722376 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.292035 Jul 21 22:55:05.843052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1042/1945] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:06.860690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:06.861307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:06.868461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:06.868938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:06.869707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:06.870142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:06.931137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:06.939528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:06.941151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:06.942307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d6ad3753-49c3-4fce-9ec4-7d792c8a1fce tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085589 Jul 21 22:55:06.942930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 904/1946] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:07.960439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:07.961074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:07.967783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.968232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:07.969030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:07.969462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:08.031632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:08.040832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:08.042335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:08.043787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-651ae41a-3eb6-4dfd-946c-c0190bcc22ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087656 Jul 21 22:55:08.044352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1043/1947] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:07 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:09.062192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:09.062810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:09.070181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.070636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.071412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:09.071851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:09.136225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:09.144687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:09.147091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:09.148234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cd93119c-4f5f-46bd-837d-6734efcf8490 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089962 Jul 21 22:55:09.148826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 905/1948] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:10.166152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:10.166747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:10.173134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.173575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:10.174318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:10.174748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:10.237023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:10.246095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:10.247593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:10.248750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f7b2cba8-5c70-45db-adeb-b6c83e5d3f5a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086549 Jul 21 22:55:10.249298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1044/1949] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:11.267511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:11.269042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:11.277159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.277945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.279087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:11.279691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:11.346088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.355218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.357108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:11.358286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0ba85bc4-f9c3-4b7d-b98c-ea17cf4c2ff9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.094924 Jul 21 22:55:11.359054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 906/1950] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:12.376531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:12.377156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:12.384951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.385397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.386149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:12.386626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:12.450287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:12.458976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:12.460701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:12.461838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bbcf7062-1ee9-469b-9afe-f1667e57fe94 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089331 Jul 21 22:55:12.462388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1045/1951] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:13.480140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:13.480759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:13.487521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.487967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.488750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:13.489185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:13.551973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.560463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.561989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:13.563119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-96f4a71d-1b4b-4b11-a4b7-74c7395a8442 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086999 Jul 21 22:55:13.563674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 907/1952] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:14.581982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:14.582590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:14.589737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.590177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.590929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:14.591354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:14.655799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.664858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.666362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:14.667489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-14398304-2ce4-4680-a640-c2ee8fa11232 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089485 Jul 21 22:55:14.668044 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1046/1953] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:15.439236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.439796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.446467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.446919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.447693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.448130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.452158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=84 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:15.475105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:55:15.559629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2f149f72-ce1c-4ccc-b063-fe6d429d8694 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 204 len: 0 microversion: 2.1 time: 0.123461 Jul 21 22:55:15.560419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 908/1954] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:55:15 2022] DELETE /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:55:15.560780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.561289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.569025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.569503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.570263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.570732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.573016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.573735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.580647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.581100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.581872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.582304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.600315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:55:15.663140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR oslo.messaging._drivers.impl_rabbit [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [827663e7-bc57-47c9-9e20-92a8c947ba3f] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:55:15.723869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.732171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-70c1bf48-d3b9-4874-86c5-759fea715396 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.164532 Jul 21 22:55:15.732773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 909/1955] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:15 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:15.737930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:15.738545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:15.744450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.744931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.745696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:15.746133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:15.810008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.818994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.820527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:15.821671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be181a53-d241-4f63-b366-7fbc4a479336 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087370 Jul 21 22:55:15.822228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 910/1956] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:16.670789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [827663e7-bc57-47c9-9e20-92a8c947ba3f] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 56714. Jul 21 22:55:16.690395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-62b5bc9d-4a6d-45ff-808f-d233a59d3849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 204 len: 0 microversion: 2.1 time: 1.134097 Jul 21 22:55:16.691195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1047/1957] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 22:55:15 2022] DELETE /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 0 bytes in 1136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:55:16.700987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.701713 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.709123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.710235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.711029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.711584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.750563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.751263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.758329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.758774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.759549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.759981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.846411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.854773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86ee5535-530d-4396-a69a-8ab2a882a430 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157967 Jul 21 22:55:16.855351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 911/1958] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:16.860634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:16.860634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:16.867422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.868017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.868688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:16.869134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:16.894441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.903039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-39132c8b-a535-4210-9abd-aba83824b3fb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156541 Jul 21 22:55:16.903637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1048/1959] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:16.932715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.941230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.942671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:16.944668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f2cbea53-5633-45d5-ab62-7ac6dfa496e3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088366 Jul 21 22:55:16.945231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 912/1960] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:17.870960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:17.871566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:17.878113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.878553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.879306 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.879757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.923964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:17.925125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:17.932879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.933352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:17.934110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:17.934548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.020290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.029266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e350cbc4-791c-425f-a95c-0c5b801e429a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.162113 Jul 21 22:55:18.029841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1049/1961] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:18.040210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:18.040836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:18.042735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:18.047996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.048435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.049217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:18.049648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:18.072589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.080614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-30ac4eec-b1ee-42e2-8308-4335f1adcda0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.163803 Jul 21 22:55:18.081433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 913/1962] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:17 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:18.111741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.120209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.121800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:18.122881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-05316bb3-59d6-4012-9af7-e13c3b94ee14 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088992 Jul 21 22:55:18.123427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1050/1963] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:18 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:19.046226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.046831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.053598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.054023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.054787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.055218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.098541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.099876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.106418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.106857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.107616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.108078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.184722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.193143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ab6123a4-9966-4178-92b5-8cb9f4fe29cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150519 Jul 21 22:55:19.194263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 914/1964] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:19.199533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:19.200145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:19.206197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.206680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.207452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:19.207890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:19.236197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.245025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ae6ef53d-9fc0-4ecb-8199-efe0d57236e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150296 Jul 21 22:55:19.245608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1051/1965] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:19.273449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.282343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.283854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:19.285065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6b2d367e-8d1b-4ea2-87dd-ec60e60a1023 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089871 Jul 21 22:55:19.285629 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 915/1966] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:20.211819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.212702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.220207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.220756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.221704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.222139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.262230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.263069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.269602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.270064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.271726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.272211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.356735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.365009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac4d6473-1c7d-4cbf-afd0-26e622c2faa4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157700 Jul 21 22:55:20.366187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1052/1967] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:20.370709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:20.371321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:20.377249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.377694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.378455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:20.378882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:20.410486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.418751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f0caf1ea-d037-42ad-90e8-86e392104fb3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.160265 Jul 21 22:55:20.419329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 916/1968] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:20.444456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.453055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.454576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:20.455726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f81c567-1bd8-46a9-8888-583cc679adec tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088614 Jul 21 22:55:20.456277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1053/1969] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:21.382774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.383452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.385806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:21.392028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.392500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.393285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.393729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.437002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.437618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.445046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.445515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.446492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.446926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.529333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.538116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9ecea099-25de-4ba6-bdb7-c02e9f7d2211 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159460 Jul 21 22:55:21.538700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 917/1970] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:21.543373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:21.543822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:21.549937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.550390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.551161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:21.551600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:21.580582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.589326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb45f207-707a-4fc3-976d-3f32cc59d2d2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156233 Jul 21 22:55:21.589925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1054/1971] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:21.616926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.625605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.627130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:21.628282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5bdcf651-d4f1-43d8-9c6c-0fe39bb7d8ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088655 Jul 21 22:55:21.628887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 918/1972] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:22.554543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.555154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.561754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.562204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.562960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.563398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.606581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.607208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.613700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.614146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.614920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.615355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.696335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.704705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4eacadb3-61a5-4846-a763-b3d0b36f5876 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153929 Jul 21 22:55:22.705484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1055/1973] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:22.710677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:22.711276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:22.717272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.717718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.718472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:22.718895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:22.747451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.755912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5f7e0a4f-bf40-4d2d-91e7-d71054b29215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152874 Jul 21 22:55:22.756583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 919/1974] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:22.781567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.790675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.792171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:22.793327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cab4e83b-38bb-4d11-8ed9-158cf475ffaf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087080 Jul 21 22:55:22.793877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1056/1975] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:23.721924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.722518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.729162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.729606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.730367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.730798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.773538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.774461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.781128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.781575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.782342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.782807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.785447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:23.862731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.870901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c6305ea-70c9-4a64-8dd3-bb1046cd3a7c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152810 Jul 21 22:55:23.871474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 920/1976] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:23.876020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:23.876792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:23.883765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.884209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.884996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:23.885428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:23.914295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.922520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-de695007-c7f9-4f93-b8cb-1b7b92fdb9d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152973 Jul 21 22:55:23.923094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1057/1977] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:23.950654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.959502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.961037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:23.962168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c3e041c0-97ae-41f2-972a-7e1f8dfeb4d5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089799 Jul 21 22:55:23.962724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 921/1978] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:24.888115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.888797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.895262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.895706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.896626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.897059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.941391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:24.941938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:24.949592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.950047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:24.950822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:24.951391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.042058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.050427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b05c40f8-77b6-4f58-8e11-53a5899b6444 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.166185 Jul 21 22:55:25.051018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1058/1979] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:25.056596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:25.057206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:25.063692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.064138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.064940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:25.065408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:25.130649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.139892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.141449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.142617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e7b66fe5-eea7-4c59-933d-538b3bd2b31f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090680 Jul 21 22:55:25.143179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1059/1980] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:25.317092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:25.325240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-38f2e1b5-62be-4a11-8906-bdecc57f81b7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.387888 Jul 21 22:55:25.325814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 922/1981] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:24 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:26.069147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.069762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.076365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.076854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.077620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.078062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.161343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.161954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.168781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.169281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.170054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.170486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.174823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:26.220783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.228272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6f0430dd-0dee-4839-8196-e4b9a7a72078 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.163471 Jul 21 22:55:26.228891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1060/1982] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:26.241753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.250970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.252919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.254073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d2a28a7c-88bb-4127-9478-5f5d729c055c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.096769 Jul 21 22:55:26.254628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 923/1983] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:26.342465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:26.342989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:26.349528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.349975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.350753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:26.351191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:26.510395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:26.519030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b624b83-8c4d-4d44-8db0-01fe8bed6957 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.180462 Jul 21 22:55:26.519618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1061/1984] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:26 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:27.245691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:27.246305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:27.252890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.253338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.254093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.254529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.276651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:27.277261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:27.283827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.284278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.285077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.285517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.347334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.357101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.358735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.360015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-26a82c41-71ad-4777-a343-de91a177da7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087347 Jul 21 22:55:27.360692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1062/1985] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:27.389922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.397961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4ac75a16-d4d2-40c8-836e-ed8fcff0f619 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156151 Jul 21 22:55:27.398518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 924/1986] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:27.537936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:27.538504 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:27.544575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.545019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.545764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:27.546193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:27.673155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:27.681758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-23592018-63a7-4f08-bf53-a63c476af513 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148525 Jul 21 22:55:27.682321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1063/1987] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:27 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:28.379204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:28.379809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:28.387493 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.387942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.388743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.389179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.414741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:28.415436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:28.424877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.425656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.427492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.428456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.459165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.468093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.469638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.470790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b023d09f-5741-4c5d-b7f1-0d91420b547d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095589 Jul 21 22:55:28.471353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 925/1988] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:28 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:28.563787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.572315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9132b6c3-85c8-4309-af19-df179e91646b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.161541 Jul 21 22:55:28.573046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1064/1989] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:28.698843 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:28.699389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:28.705527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.705986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.706753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:28.707194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:28.835820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:28.843804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-73d3be8c-24d4-458e-acc6-e8d5530f31b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148939 Jul 21 22:55:28.844363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 926/1990] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:28 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:29.491049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.491726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.498331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.498775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.499539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.499969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.563421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.572566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.574118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.575297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7d730065-3451-46e3-a0f7-71cb94f12830 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088375 Jul 21 22:55:29.575855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1065/1991] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:29.589199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.589816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.596452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.596937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.597704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.598146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.728052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:29.736008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dfc8ab41-fc12-4759-bac3-dbdcd4288c09 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150678 Jul 21 22:55:29.736603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 927/1992] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:29.861423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:29.862024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:29.868469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.868945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:29.869700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:29.870129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.002996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.011934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5e224319-125f-4987-9f5e-d9ffec1955c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154425 Jul 21 22:55:30.012524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1066/1993] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:30.594098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.594732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.602005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.602450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.603218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.603640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.665794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.674087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.675591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.676750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0154fb3c-ba43-4e06-83b5-7c962a272c51 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086580 Jul 21 22:55:30.678027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 928/1994] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:30.753063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:30.753605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:30.760449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.760932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.761694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:30.762132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:30.889810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:30.898357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9a0752ab-d57e-4482-9746-fa8ca2f0155a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149192 Jul 21 22:55:30.898917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1067/1995] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:31.029541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:31.030079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:31.036058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.037326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.038092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.038526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.163532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.171423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e870ec3f-7fd4-4425-9554-6d4a41348450 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145818 Jul 21 22:55:31.171983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 929/1996] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:31.696122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:31.696682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:31.702685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.703132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.703888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.704319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.764729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.773654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.775167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:31.776303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c3e9e496-c70e-4b19-8e41-62c441fa1c7f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084743 Jul 21 22:55:31.776891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1068/1997] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:31.915374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:31.915981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:31.922514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.922955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:31.923710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:31.924143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.054812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.062634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4c675e5f-5618-423a-88b8-2b2770a5f6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151559 Jul 21 22:55:32.063213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 930/1998] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:32.188298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:32.188966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:32.194932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.195384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.196145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.196612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.328806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.337424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bfcf5fd9-ed36-4add-a823-bcc909efeb4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152957 Jul 21 22:55:32.337989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1069/1999] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:32.795612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:32.796219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:32.802224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.803391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.804277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:32.804744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:32.864238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.873193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.874690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:32.875820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18e97209-09ea-4a52-a781-921e2fb2f8f1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084121 Jul 21 22:55:32.876370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 931/2000] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:33.080159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.080720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.087936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.088385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.089171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.089604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.220408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.229287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c344685e-e9f4-49ae-890f-c32412667be7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152987 Jul 21 22:55:33.229863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1070/2001] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:33.354806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.355356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.361953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.362404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.363169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.363605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.498152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.507401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-727feb25-5a66-4515-af40-fe23edb57b5c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156098 Jul 21 22:55:33.507976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 932/2002] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:33.893545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:33.894149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:33.900261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.900735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.901482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:33.901911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:33.961497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.969788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.971280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:33.972410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-debdc7de-cb6e-4e67-88ab-162f2e9167c8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.082773 Jul 21 22:55:33.972987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1071/2003] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:34.246780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.247318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.253371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.253823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.254644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.255081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.525031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.525568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.531661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.532109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.532898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.533399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.545360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.553726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a542bd46-2ddb-48c3-9c21-35c362b8c185 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.310855 Jul 21 22:55:34.554291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 933/2004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:34.664196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:34.672061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-48aea32d-0ee2-4763-8e12-94d360f866a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151674 Jul 21 22:55:34.672643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1072/2005] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:34.990722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:34.991354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:34.997370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.997823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:34.998624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:34.999063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.060328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.069009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.070520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.071649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-274179d7-de0f-46e6-8323-8b7d8247c44a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085499 Jul 21 22:55:35.072185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 934/2006] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:35.571505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.572033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.578497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.578947 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.579691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.580120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.690061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:35.690710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:35.697584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.698040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.698818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:35.699261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:35.707416 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.711472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:35.716920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5bebed47-0fc8-4631-8234-a56e584fd3f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150013 Jul 21 22:55:35.717492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1073/2007] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:35.834759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:35.842623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6009f04e-d40d-4e96-97f8-63dce3da30a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156429 Jul 21 22:55:35.843199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 935/2008] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:35 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:36.089813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.090350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.096261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.096740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.097509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.097946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.162692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.171090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.172673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.173821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3d5c2034-c36a-4f67-bffd-e67b0e6c05e5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088309 Jul 21 22:55:36.174511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1074/2009] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:36.499400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:55:36.499611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:55:36.733295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.733910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.740595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.740967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.741733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.742173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.859286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:36.860040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:36.866762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.867208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.867975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:36.868408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:36.869005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:36.876959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a651ab4a-5563-45c6-8e67-94fc4f95223e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147582 Jul 21 22:55:36.877518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 936/2010] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:36.995251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.003191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-631431bb-7433-4cef-855e-5747494e73ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147839 Jul 21 22:55:37.003751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1075/2011] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:37.192456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:37.193927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:37.200494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.200960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.201736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.202175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.264790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.273988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.275555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:37.276756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-66a1378f-6a10-49fa-a0cf-a6259768de06 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088323 Jul 21 22:55:37.277305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 937/2012] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:37.894313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:37.894929 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:37.901458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.901911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:37.902672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:37.903112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.020738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:38.021677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.027954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.028405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.029099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.029266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.029734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.038213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-447297df-cc69-4deb-97d2-a2fb7e562768 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147712 Jul 21 22:55:38.038786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1076/2013] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:38.161192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.169668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1c15f3ed-265d-491c-8cf3-8548220bcdea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152962 Jul 21 22:55:38.170222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 938/2014] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:38.294491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:38.295105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:38.301103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.301552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.302347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:38.302913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:38.369075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.377619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.379146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:38.380281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d6b813a7-d7de-42a9-9278-13d6c36e7316 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089817 Jul 21 22:55:38.381047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1077/2015] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:39.055860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.056487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.062952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.063402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.064168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.064632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.186764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.187373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.194875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.195330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.195954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.196104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.196631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.198238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:39.205278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b66f781a-29d9-473b-a1ec-5b4cff8fb57b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154172 Jul 21 22:55:39.205835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 939/2016] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:39.330037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.338115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5a7e026d-3aa9-4df7-82f7-d12386549f2a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155188 Jul 21 22:55:39.338673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1078/2017] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:39.398290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:39.398916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:39.405015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.405457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.406327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:39.406764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:39.468055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.476911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.478463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:39.479586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4b65c024-978d-45c1-8e61-0a4c786a732b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085251 Jul 21 22:55:39.480206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 940/2018] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:39 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:40.222330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.222927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.230542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.230988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.231746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.232179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.354972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.355583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.361313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.362571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.363031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.363977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.364417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.369428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a2e583d9-e765-4547-9fca-e6d2291f4d11 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150952 Jul 21 22:55:40.370070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1079/2019] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:40.500762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:40.500762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:40.501035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.504472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.504939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.505702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:40.506893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:40.507943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-12e7db96-00ba-4212-9866-646c747cbaf6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156673 Jul 21 22:55:40.508527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 941/2020] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:40.571279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.579556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.581085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:40.582216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-967d33c4-60f8-4b3f-83d6-03373957a0e6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088452 Jul 21 22:55:40.582767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1080/2021] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:41.387274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.387889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.394402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.394855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.395616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.396051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.526499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.529730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.530351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.534514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b276c160-4677-4fc0-9cf2-5e045f1fd572 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151089 Jul 21 22:55:41.535087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 942/2022] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:41.537696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.538149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.538912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.539342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.599205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:41.600315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:41.606247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.606691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.607455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:41.607887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:41.667897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.668867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.676003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-aec32048-2481-4132-b140-314f57f9dc50 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150188 Jul 21 22:55:41.676580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1081/2023] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:41.677160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.679436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:41.680600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bce66baf-e888-4474-9388-a9ee2f9e4ab4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085356 Jul 21 22:55:41.681136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 943/2024] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:42.552138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.553061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.559240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.559691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.560443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.560900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.687512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.694528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.695152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.696507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a68c025c-4f8e-4e2f-83a9-942a4e2899e7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148194 Jul 21 22:55:42.697089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1082/2025] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:42.701653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.702106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.702877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.703316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.709314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:42.709932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:42.715740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.716181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.716955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:42.717383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:42.781724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.790512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.792024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.793201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e1aa3651-e5ab-4d91-96d2-77ee450e1db3 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095133 Jul 21 22:55:42.793760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1083/2026] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:42.839690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:42.851709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-29066b24-fd51-446d-b894-86a3551b8e9f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.161340 Jul 21 22:55:42.852582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 944/2027] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:42 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:43.255244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:55:43.255530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:55:43.713379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.713987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.720521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.720974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.721736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.722169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.811147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.811848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.819937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.820763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.822109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.822862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.856784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.864840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b46f3b93-6b52-4889-9599-403057e0c72c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155234 Jul 21 22:55:43.866244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1084/2028] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:43.870678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:43.871288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:43.877134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.877580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.878340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:43.878769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:43.889331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.898042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.899548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:43.900743 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ad911c9c-b4ee-4f66-a26e-c52e3e5ec89a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093496 Jul 21 22:55:43.901297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 945/2029] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:44.008204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:44.016282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4905a431-6226-45b0-ac04-c428d75fbf0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149235 Jul 21 22:55:44.016879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1085/2030] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:44.887023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:44.887632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:44.894173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.894617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.895371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.895801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.918481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:44.919196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:44.925726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.926176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.926930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:44.927384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:44.993378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.001912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.003437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.004612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab22412b-09db-4255-a9cf-38bee68947a4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089974 Jul 21 22:55:45.005181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1086/2031] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:44 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:45.030960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.032625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:45.033243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:45.038951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4273bc93-6975-4cb2-b046-f4dd49fd0e40 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155789 Jul 21 22:55:45.039501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 946/2032] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:45.039774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.040221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.041013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:45.041446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:45.169598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:45.177462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a9fb6b17-fc6f-4ad1-bc9f-dc4db0347c7c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148616 Jul 21 22:55:45.178064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1087/2033] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:46.023989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.024632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.031180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.031634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.032406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.032873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.056414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.057081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.063426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.063872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.064652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.065084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.095764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.105198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.106688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.107835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c76a228-fd77-47cd-9bc7-5c2cb4fed956 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087860 Jul 21 22:55:46.108381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 947/2034] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:46.193899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.194612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:46.195231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:46.201303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.201749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.202246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0a2b16b9-168a-4092-8ec7-584810cd6678 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150212 Jul 21 22:55:46.202507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:46.202994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1088/2035] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:46.203124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:46.330957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:46.338781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4a81d095-473a-43ec-b9c4-903b9ae0a5d3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148032 Jul 21 22:55:46.339325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 948/2036] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:47.126805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.127400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.134308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.134749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.135491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.135919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.199906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.208213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.210276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.211401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b47fee3-6836-4a7d-9f71-1a1c0d8f5054 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088497 Jul 21 22:55:47.211944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1089/2037] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:47.218899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.219562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.226676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.227154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.227912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.228341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.355885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:47.356526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:47.360428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.362466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.362919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.363689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:47.364126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:47.368571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2580aed0-ec63-4a67-a98b-d052fc60613a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153459 Jul 21 22:55:47.369130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 949/2038] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:47.378839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:47.493686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:47.501646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-773366df-6201-4395-9fac-e55f1b629278 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149643 Jul 21 22:55:47.502214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1090/2039] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:47 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:48.229568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.230177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.236649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.237103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.237866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.238302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.300899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.310249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.311810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.312995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a04bf838-10e6-47bc-9331-59db3759cd83 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087387 Jul 21 22:55:48.313558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 950/2040] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:48.386133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.386778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.389133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=82 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:48.394328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.394783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.395544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.395981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.519314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:48.519858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:48.524871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.526312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.527126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.527970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:48.528526 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:48.533149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0d647241-6f6f-4587-b926-0ef6a024d59a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151081 Jul 21 22:55:48.533714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1091/2041] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:48.658124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:48.666606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a8cb7ca7-082b-4f2e-875d-a761ac2dbca1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151261 Jul 21 22:55:48.667156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 951/2042] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:48 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:49.330920 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:49.331526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:49.338661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.339103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.339858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.340290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.406309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.414741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.416260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.417507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e0ced7e7-19ad-4e55-9967-24e5fbf5c04f tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090601 Jul 21 22:55:49.418066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1092/2043] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:49 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:49.550543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:49.551159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:49.558338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.558732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.559495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.559937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.683564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:49.684238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:49.690129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.690278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.690577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.691329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:49.691755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:49.699345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-72b4d74c-42b8-4106-9bc2-187a8c2e8f0b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152769 Jul 21 22:55:49.699909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 952/2044] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:49.820129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:49.827875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-59f7ec6e-32c5-4674-b2c8-07db415b858b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148113 Jul 21 22:55:49.828433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1093/2045] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:49 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:50.436368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.437048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.443814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.444268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.445060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.445496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.506815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.515356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.516908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.518046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4fe16a9e-64b3-4c2d-8ed0-40470a77a2b9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085582 Jul 21 22:55:50.518597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 953/2046] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:50.715936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.716501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.723047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.723497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.724822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.725263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.845423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:50.846148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:50.851159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.853317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.853774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.854545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:50.854985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:50.859771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52f476c8-4d4d-419e-8a8a-4a2dac9a851b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147749 Jul 21 22:55:50.860335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1094/2047] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:50.989258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:50.997308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0b7dfc8f-2643-40bc-a95c-21e0127f06d4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155812 Jul 21 22:55:50.997874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 954/2048] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:51.536280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:51.537175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:51.542870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.543318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.544075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.544526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.607585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.615896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.617430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:51.618590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1eb3c68e-ec9b-4eb4-b666-7c754dac19ee tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086193 Jul 21 22:55:51.619141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1095/2049] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:51 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:51.877394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:51.877952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:51.879759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=76 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:51.886131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.886583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:51.887345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:51.887780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.014297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:52.015100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:52.017031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.022362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.023039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.023841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.024279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.024962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a02b95a7-0649-44c8-a5f7-9c52e8f77aaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151655 Jul 21 22:55:52.025527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 955/2050] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:52.154022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.162414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8fa695df-5f1a-4474-a80d-68286447b6c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151465 Jul 21 22:55:52.162969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1096/2051] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:52.636604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:52.637224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:52.643260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.643715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.644498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:52.644938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:52.660774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:55:52.707024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.715894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.717438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:52.718583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b4a35006-5c21-410f-b954-f72146f09ddb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086218 Jul 21 22:55:52.719138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 956/2052] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:52 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:53.042037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.042682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:53.049239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.049698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.050456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.050893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.176970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.180049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.181945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:53.185997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ae0acbc8-8dc7-46c5-b0da-66cff98c31c5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147856 Jul 21 22:55:53.186563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1097/2053] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:53.188410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.188894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.189663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.190098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.316834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.324824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-44d87e17-ba93-4f95-b0ea-512a4b6daba6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149531 Jul 21 22:55:53.325384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 957/2054] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:53.737141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:53.737746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:53.743963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.744407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.745186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:53.745615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:53.808520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.816865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.818923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:53.820049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5270b351-bec2-4cbf-9614-435f6f1edfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086776 Jul 21 22:55:53.820623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1098/2055] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:53 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:54.203742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:54.204390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.211363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.211841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.212636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.213074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.342475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:54.343140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.345512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.349547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.350927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.351686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.352117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.353477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8aa393a5-ca9f-49b0-88f9-392d15b5b6fa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153614 Jul 21 22:55:54.354055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 958/2056] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:54.484129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.492271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ed5aac0-3841-429d-836e-5818c814a40a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153574 Jul 21 22:55:54.492882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1099/2057] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:54 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:54.837698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:54.838313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:54.844294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.844776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.845543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:54.845979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:54.907578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.915889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.917447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:54.918587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-85f01f46-fe27-49b1-b6bf-fbaa43af3d74 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084885 Jul 21 22:55:54.919135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 959/2058] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:54 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:55.371005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:55.371650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:55.378114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.378562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.379313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.379746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.508563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:55.509844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:55.510474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:55.516899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2381d931-efde-4476-a73e-599c19d3784e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149819 Jul 21 22:55:55.517074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.517459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.517614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1100/2059] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:55.518548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.518996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.653231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:55.661210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc750136-f527-490f-9e3c-31dcbc9a85e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155529 Jul 21 22:55:55.661771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 960/2060] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:55.936688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:55.937207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:55.943584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.944015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:55.944782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:55.945210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.008550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.016856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.018351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.019480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e32b69a3-4051-4702-b319-036a12d0719e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086856 Jul 21 22:55:56.020028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1101/2061] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:55 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:56.534696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:56.535292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:56.542833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.543285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.544046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.544508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.675125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.679232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:56.679849 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:56.684422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb0151c9-ece2-4252-8e22-b2c049287b28 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153551 Jul 21 22:55:56.685055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 961/2062] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:56.686603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.687052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.687807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:56.688234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:56.815654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:56.823565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-29e88156-463b-4359-a7d1-d2766ad92d68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148651 Jul 21 22:55:56.824122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1102/2063] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:57.037478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.038085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.044070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.044540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.045309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.045739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.106377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.114589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.116123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.117280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a81276a3-06e2-4399-afc7-6a3e006ab9c6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084288 Jul 21 22:55:57.117827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 962/2064] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:55:57.701980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.702505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.708926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.709397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.710065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.710496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.837862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.840681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:57.841828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:57.845775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-057e091e-ccd1-4947-aad0-6b95fa3c64ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147697 Jul 21 22:55:57.846338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1103/2065] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:57.848277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.848768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.849588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:57.850027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:57.978518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:57.986508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-912a0967-c64d-469d-ba5e-12960df7f7cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149746 Jul 21 22:55:57.987073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 963/2066] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:58.135009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.135614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.141616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.142061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.142842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.143276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.211552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.219914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.221447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:58.222575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6f27618-cca7-4142-8693-67fa46ebdf22 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091787 Jul 21 22:55:58.223149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1104/2067] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:55:58.863050 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:58.863667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:58.871147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.871921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:58.872744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:58.873188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.003049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.004500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:59.005125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:59.012237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f7efe7e3-6e0b-4e19-b583-219eb24ea78d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153082 Jul 21 22:55:59.012551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.012826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 964/2068] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:55:59.013003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.013772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.014236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.143015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.151559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-509ef45f-2e7d-40b8-927d-ac64e1c9810a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150905 Jul 21 22:55:59.152118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1105/2069] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:55:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:55:59.241477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:55:59.242078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:55:59.248072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.248555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.249313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:55:59.249744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:55:59.320705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.329130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.330637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:55:59.331775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd4461a0-d045-4183-a36c-cb9603cdb987 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.095098 Jul 21 22:55:59.332324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 965/2070] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:55:59 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:00.029949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:00.030500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:00.037626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.038088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.038848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.039284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.166753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.168842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:00.169486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:00.174618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-922cae37-e958-43c0-b020-8f5532aad725 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148681 Jul 21 22:56:00.175182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1106/2071] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:00.175862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.176307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.177197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.177677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.311531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.320065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-35a583e8-c86f-4ece-8fc8-a69952466954 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155050 Jul 21 22:56:00.320659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 966/2072] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:00.349475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:00.350156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:00.356016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.356457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.357228 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:00.357656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:00.360110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:00.424415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.432942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.434443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:00.435579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bbe05d3a-6494-42d9-8602-52c718e44025 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090138 Jul 21 22:56:00.436137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1107/2073] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:00 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:01.191361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.191968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.198660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.199106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.199857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.200289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.328235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.336938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e09fbc5e-e7b7-4502-9938-44c24aa967fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149369 Jul 21 22:56:01.337346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.337807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 967/2074] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:01.337957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.344327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.344801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.345552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.345981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.454538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:01.455088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:01.461861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.462312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.463084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:01.463532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:01.473657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.482242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42d50542-171e-4993-bffc-9f80c36050e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148692 Jul 21 22:56:01.482804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1108/2075] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:01.526878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.535437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.537592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:01.538946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4caee2bf-d9c6-486b-970f-b6106da577ae tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088454 Jul 21 22:56:01.539501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 968/2076] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:01 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:02.353881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.354517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.360966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.361417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.362175 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.362610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.496653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.499137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.499749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.504769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1080347c-2055-49c1-85e4-363c54532c35 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154732 Jul 21 22:56:02.505381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1109/2077] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:02.507916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.508369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.509306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.509969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.559303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:02.559909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:02.566213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.566662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.567432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:02.567966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:02.646262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.657024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.659715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.660952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-949af53a-1b13-4156-bb99-642e873359b1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.106214 Jul 21 22:56:02.661526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1110/2078] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:02.670390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:02.679563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a8401b5c-eda7-4a80-b0b4-b2777e93c7cd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.184185 Jul 21 22:56:02.680148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 969/2079] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:02 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:03.524456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.525085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.531500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.531942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.532728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.533157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.662579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.670769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37491cc4-d4dc-4a5c-808c-3c01b1e0cf6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150190 Jul 21 22:56:03.671335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1111/2080] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:03.683545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.684166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.690630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.691250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.691822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.692251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.696123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:03.696764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:03.702638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.703088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.703844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:03.704281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:03.756234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.765106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.766637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.767800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cda18738-e8b5-451d-ac3a-e26003a64a0b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088167 Jul 21 22:56:03.768361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 970/2081] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:03.833007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:03.840915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96c6f520-861f-4e06-a8d7-3e6007f27cbe tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148643 Jul 21 22:56:03.841484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1112/2082] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:04.687030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.687648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.694624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.695076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.695847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.696286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.785325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.785975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.793163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.793619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.794384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.794821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.830671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.839539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6273c07c-dce0-4b79-b4e1-96317286d4b8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156335 Jul 21 22:56:04.840109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 971/2083] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:04.857953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:04.858816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:04.860957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.865219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.865744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.866592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:04.867099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:04.870046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.871563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:04.872737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc2b29ba-f642-425c-9fa0-34213c2af72c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091364 Jul 21 22:56:04.873288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1113/2084] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:04.993841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.001723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d64d64f4-0912-40da-aeef-f1a23123cf2b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147527 Jul 21 22:56:05.002282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 972/2085] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:05.857129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.857749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.864253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.865394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.866340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.866781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.891191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:05.891806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:05.898940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.899387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.900154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:05.900615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:05.903189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:05.964073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.972518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.974114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:05.975273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9528748f-2712-4536-ace8-fe9e63ccbfda tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087986 Jul 21 22:56:05.975833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 973/2086] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:05.996185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.004004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ed1a447-ea9f-49bd-9a38-ee0ceb1fd315 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150787 Jul 21 22:56:06.004572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1114/2087] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:06.018930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:06.019542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:06.025584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.026031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.026782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:06.027212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:06.156450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:06.165123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3bf8f2d9-0c9c-46ca-86f4-7e5f17ac75b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149943 Jul 21 22:56:06.167374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 974/2088] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:06.993531 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:06.994146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.000558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.001012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.001764 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.002199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.022727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:07.023349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.029851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.030308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.031081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.031524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.062776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.071864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.073397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.074578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-27a36f19-e417-4fb3-bdd6-349aa8015136 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085271 Jul 21 22:56:07.075142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1115/2089] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:06 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:07.160614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.168964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e7817cf-774a-4c9d-b8ed-359170f672d8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150998 Jul 21 22:56:07.169527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 975/2090] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:07.182048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:07.182651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:07.188916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.189357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.190099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:07.190528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:07.324524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:07.332577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c589c638-86f1-49da-9db0-5950f9800885 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154339 Jul 21 22:56:07.333134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1116/2091] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:08.093776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:08.094437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.101637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.102091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.102863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.103303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.166473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.174955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.176506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.177694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c3947470-048f-4426-9fce-3d06de933231 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087936 Jul 21 22:56:08.178295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 976/2092] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:08 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:08.186131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:08.186739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.193756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.194201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.194979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.195408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.322081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.329966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c08408fb-1af6-47ce-b488-58c63ae61317 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147627 Jul 21 22:56:08.330522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1117/2093] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:08.350581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:08.351127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:08.357124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.357572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.358373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:08.358811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:08.490633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:08.498456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-49baf02f-01e3-4703-81c0-bd2b9a0397e5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152445 Jul 21 22:56:08.499015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 977/2094] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:08 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:09.195804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:09.196439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:09.202894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.203341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.204094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.204553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.264786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.273187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.274696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.275854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bc685a45-9f02-433f-93e4-3ffdb4724af2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084536 Jul 21 22:56:09.276414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1118/2095] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:09 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:09.347256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:09.347871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:09.354987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.355440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.356207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.356683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.485524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.494099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-33a1bf6c-1e52-4b69-b513-57ea9aca785d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150789 Jul 21 22:56:09.494653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 978/2096] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:09.516158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:09.516790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:09.522683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.523124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.523868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:09.524301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:09.652070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:09.660119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6f95b27d-25d5-4bf7-b371-bcab5694dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147767 Jul 21 22:56:09.660715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1119/2097] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:10.294041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:10.294669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.300672 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.301123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.301885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.302450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.362364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.370810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.372325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.373516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2da3fdd7-50eb-45dd-a75d-f618ec865b17 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.083459 Jul 21 22:56:10.374074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 979/2098] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:10 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:10.511666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:10.512268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.518786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.519226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.519970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.520397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.652917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.660836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8a2716a8-c7e3-4961-8a08-caa8f1864fe0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152970 Jul 21 22:56:10.661449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1120/2099] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:10.678257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:10.678883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:10.684850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.685304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.686070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:10.686509 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:10.816991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:10.825196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-90c27c6a-707a-4347-8ba6-d4e837173f27 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151362 Jul 21 22:56:10.825766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 980/2100] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:10 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:11.391674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.392317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.398558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.399010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.399770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.400213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.463115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.472204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.473946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.475193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08456a83-0e27-45d8-bc5b-7dabe58a7e71 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087432 Jul 21 22:56:11.475957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1121/2101] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:11.678540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.679080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.685755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.686204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.686967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.687406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.813710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.821564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f65d756a-e2cf-44b3-b95d-60ab27cc2011 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147792 Jul 21 22:56:11.822134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 981/2102] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:11.842409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:11.843020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:11.849400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.849851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.850600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:11.851026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:11.979685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:11.987545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b1dfd710-95a4-4080-a231-42b0bb868090 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149055 Jul 21 22:56:11.988101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1122/2103] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:11 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:12.493360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:12.493994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:12.500016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.500470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.501260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.501696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.563560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.572643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.574160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.575302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9168488a-b907-44a2-9085-4f6dcfef0675 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086266 Jul 21 22:56:12.575861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 982/2104] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:12.838212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:12.838817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:12.845276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.845844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.846459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:12.846889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:12.975236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:12.977436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:12.984844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92cc009c-f025-41c7-9870-608af43e5fd5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150413 Jul 21 22:56:12.985526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1123/2105] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:13.004776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:13.005577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:13.012274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.012770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.013544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.013987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.146198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.154112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a035d543-e6df-4946-ac09-303cac046776 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153199 Jul 21 22:56:13.154676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 983/2106] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:12 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:13.593902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:13.594509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:13.601765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.602216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.602976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:13.603413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:13.666017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.674511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.676040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:13.677566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-710997fd-7f21-4e17-9118-fd4611577e4b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087666 Jul 21 22:56:13.678115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1124/2107] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:13 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:14.002289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.002900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.011156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.011815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.012360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.012822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.141591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.150090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ea3543a9-2f39-460f-b49f-d6560ed239d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151774 Jul 21 22:56:14.150655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 984/2108] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:14.170905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.171534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.179136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.179579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.180334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.180802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.312075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.321193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9947008d-a96a-4f6b-85b2-d8cab8311fd6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154107 Jul 21 22:56:14.321766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1125/2109] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:14.695382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:14.695992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:14.701970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.702420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.703182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:14.703620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:14.767490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.776021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.777560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:14.778697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-36ee426a-2679-457b-b33f-7b61082b3869 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087387 Jul 21 22:56:14.779250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 985/2110] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:14 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:15.167480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:15.168082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:15.174008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.174572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.175185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.175614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.306974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.314962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1c0466c8-4a68-49f9-b748-a79ca34265ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151359 Jul 21 22:56:15.315523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1126/2111] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:15.338953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:15.339563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:15.346018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.346463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.347217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.347649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.477806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.485806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-81d40fd7-2588-48fc-a975-a5941c5f4724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150680 Jul 21 22:56:15.486378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 986/2112] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:15 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:15.797352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:15.797961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:15.804950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.805399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.806152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:15.806587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:15.873640 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.883388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.884930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:15.886068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb0597e3-3b60-4ddb-acb1-5c03659651a2 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.092699 Jul 21 22:56:15.886649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1127/2113] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:15 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:16.332456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:16.333230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:16.339340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.339948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.340555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.340989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.469846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.478620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-af27bc4e-1ea8-4a5e-be9f-e365e7c50eb5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149925 Jul 21 22:56:16.479188 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 987/2114] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:16.503128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:16.503749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:16.510734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.511185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.511944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.512379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.638691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.647902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f17eca00-742d-4597-b7f7-5ab3bba389b2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148661 Jul 21 22:56:16.648470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1128/2115] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:16.903282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:16.903817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:16.910058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.910506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.911491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:16.912006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:16.975433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.983816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.985358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:16.986491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f393200e-15b0-4240-a808-a923bdb83eb4 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087182 Jul 21 22:56:16.987043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 988/2116] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:17.495753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:17.496362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:17.502378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.502829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.503581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.504097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.630853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.639015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c2941cee-db05-4b6d-8043-808b3e762c96 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147194 Jul 21 22:56:17.639576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1129/2117] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:17.665091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:17.665702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:17.672208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.672687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.673445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:17.673879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:17.804893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:17.807055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:17.813830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bcf85feb-0fa0-4d62-95b1-8137a67084ff tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153080 Jul 21 22:56:17.814412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 989/2118] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:17 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:18.004347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:18.005244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:18.011236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.011688 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.012561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.012943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.079384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.088315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.089889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.091039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afc56e5a-5632-4bcd-a7cf-72a4d052bdb0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090744 Jul 21 22:56:18.091598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1130/2119] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:17 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:18.656089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:18.656724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:18.662770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.663215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.663976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.664412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.792792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.800695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-01446cae-ca86-480a-abcd-876559f35746 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148418 Jul 21 22:56:18.801253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 990/2120] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:18.830452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:18.831061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:18.833877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=80 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:18.839280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.839758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.840529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:18.840961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:18.984131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:18.992800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ae86fec2-05da-4bbe-8603-dc089c5f61e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.165974 Jul 21 22:56:18.993294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1131/2121] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:18 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:19.110411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:19.111012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:19.117768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.118212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.118967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.119400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.185191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.193864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.195370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.196534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-02c606c6-2dee-48c7-a5a2-cdc95b4b0917 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090064 Jul 21 22:56:19.197086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 991/2122] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:19 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:19.818880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:19.819490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:19.825554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.826005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.826758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:19.827192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:19.953862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:19.965576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fe47c9e8-61eb-489d-bcc2-a379aec362af tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151249 Jul 21 22:56:19.966529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1132/2123] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:20.010806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:20.011415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:20.017921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.018366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.019123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.019554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.148274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.156105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f296b7b6-3438-4535-ae9d-a571e8241293 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149414 Jul 21 22:56:20.156694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 992/2124] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:20.214871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:20.215598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:20.221503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.221945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.222695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.223120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.287210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.295821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.297377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:20.298507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b1239542-ba04-4dd6-abf8-316132f6d459 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087522 Jul 21 22:56:20.299054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1133/2125] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:20 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:20.982728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:20.983361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:20.989854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.990459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:20.991214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:20.991645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.117426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.125338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7d9c6bf8-4dae-437b-b11d-9ae1b75f5073 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146529 Jul 21 22:56:21.125897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 993/2126] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:21.173553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:21.174297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:21.181984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.182432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.183218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.183651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.311265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.316651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:21.317353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:21.319901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d0661540-90c0-4ed6-8884-d16b46535226 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150374 Jul 21 22:56:21.320547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1134/2127] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:21 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:21.323379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.323834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.324944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:21.325052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:21.390897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.399584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.401133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:21.402280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-93b72c3f-11d6-416e-a72a-614789f83da5 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089617 Jul 21 22:56:21.402840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 994/2128] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:21 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:22.143093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:22.143708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:22.150391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.150842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.151601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.152055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.277383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.285148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8db896c2-e596-4097-a2a3-287ef35e5b6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.145975 Jul 21 22:56:22.285701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1135/2129] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:22.337839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:22.338505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:22.340718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=80 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:22.346130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.346576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.347331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.347765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.420932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:22.421555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:22.428003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.428453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.429284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:22.429723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:22.483440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.492117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7ebbe25-62ad-4d1e-9d1a-c232c22dd4bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.158841 Jul 21 22:56:22.492731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 995/2130] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:22.495728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.504179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.506345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:22.507729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-859de09e-ea66-4378-93c3-af11bb6dba56 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090860 Jul 21 22:56:22.508273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1136/2131] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:22 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:23.303310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:23.303909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:23.309944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.310390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.311146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.311578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.445212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.453247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-85eee18f-da1f-4af1-8442-a033238902be tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154455 Jul 21 22:56:23.453810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 996/2132] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:23.510114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:23.510729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:23.517326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.517773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.518536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.518967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.524953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:23.525561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:23.532191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.532679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.533445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:23.533879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:23.595577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.604233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.606380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.607009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-abc1a1a2-30eb-43bc-8fbd-988e8dfe3162 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.085838 Jul 21 22:56:23.607775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 997/2133] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:23 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:23.647832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:23.655959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-68d1cf58-36c5-4139-82d0-f83178870015 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149985 Jul 21 22:56:23.656541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1137/2134] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:24.470518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:24.471125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:24.478274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.478719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.479504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.479938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.606477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.614975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3c020cd8-5a0d-4e60-b742-1b058c0b57f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147665 Jul 21 22:56:24.615476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 998/2135] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:24.624694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:24.625295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:24.633446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.633887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.634636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.635064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.673213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:24.673829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:24.682159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.682766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.683872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:24.684317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:24.707472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.716423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.717956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.719100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5543bad4-c84f-4ed1-80e2-11e49ad4ba07 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.098345 Jul 21 22:56:24.719656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1138/2136] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:24 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:24.817500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:24.825407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e4699eab-684f-44dd-b2e5-538206b72297 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156081 Jul 21 22:56:24.825973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 999/2137] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:24 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:25.632196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:25.632748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:25.639163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.639604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.640349 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.640813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.737360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:25.737982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:25.745099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.745560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.746342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.746781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.770410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.778590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0e52127c-b82e-4890-8cbf-f86f61969532 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151345 Jul 21 22:56:25.779153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1139/2138] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:25.808930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.817835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.819473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.820649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f00accc6-7f54-456f-9e11-a279daf5e551 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087214 Jul 21 22:56:25.821199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1000/2139] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:25 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:25.842689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:25.843291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:25.849275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.849715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.850456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:25.850885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:25.865155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:25.976155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:25.984001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-268e1be0-6ab2-482b-b6d8-917afe99c2a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145212 Jul 21 22:56:25.984573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1140/2140] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:25 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:26.795991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:26.796632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:26.803751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.804191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.804975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.805402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.838981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:26.839586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:26.846191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.846645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.847411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:26.847844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:26.911930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.920360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.921896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.923037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1606f8e8-8dff-4a31-b242-97d7e61bdadc tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088003 Jul 21 22:56:26.923585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1141/2141] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:26 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:26.934572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:26.942715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-90820303-7a30-4a52-945b-5d46521ff6fd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150484 Jul 21 22:56:26.943268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1001/2142] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:27.001104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:27.001728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:27.008086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.008574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.009337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.009774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.136589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:27.144348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7008fdc5-e651-48a0-91e3-a44e3fb0e829 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147182 Jul 21 22:56:27.144936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1142/2143] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:26 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:27.940763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:27.941407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:27.948630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.949090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.949862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.950304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.960856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:27.962093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:27.968216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.968691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:27.969463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:27.969896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.016844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.025988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.027503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.028693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7f3b1ed9-6daa-491b-b0df-f017fad10027 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.091888 Jul 21 22:56:28.029467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1002/2144] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:27 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:28.098032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.106350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4f4a6d28-52b4-4fca-b932-a0c23d05c565 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151229 Jul 21 22:56:28.106910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1143/2145] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:28.162105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:28.162744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:28.168754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.169207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.169973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:28.170407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:28.296266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:28.304749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1bd17165-e66f-483a-a578-c2cd9cb75d60 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147066 Jul 21 22:56:28.305310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1003/2146] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:28 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:29.047369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:29.047969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:29.054559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.055004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.055750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.056178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.116108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.123403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:29.124018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:29.124606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.126116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.127254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52417f0c-03e7-400b-a1d1-424eab429ebf tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.083796 Jul 21 22:56:29.127800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1144/2147] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:29 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:29.130618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.131071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.132116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.132577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.259819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.267711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7c674277-9982-4677-ae08-ae74d963b4ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148589 Jul 21 22:56:29.268273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1004/2148] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:29.321841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:29.322404 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:29.328838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.328838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.329556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:29.329984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:29.462048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:29.470743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6b131d28-7402-44ac-afd8-88a3c1cc4cc9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152846 Jul 21 22:56:29.471304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1145/2149] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:30.145482 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:30.146095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:30.152838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.153287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.154055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.154487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.222857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.231736 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.233286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.234428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee15c5b9-83eb-46d8-a227-db3a154acb6c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.093062 Jul 21 22:56:30.234980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1005/2150] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:30 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:30.285352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:30.286576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:30.292995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.293445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.294201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.294634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.422696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.431262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b62c6f42-e7b8-41b3-9245-32ad17921703 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149714 Jul 21 22:56:30.431825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1146/2151] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:30.489888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:30.490639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:30.496671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.497124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.497893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:30.498361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:30.513861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:30.630461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:30.638558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fcb805fa-38e7-401d-ba7c-0d351a53910d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153448 Jul 21 22:56:30.639126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1006/2152] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:30 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:31.256223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:31.257106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:31.263062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.263530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.264274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.264731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.324977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.334141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.335639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.336807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e68f0131-6f82-450c-92ee-860911768344 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.084996 Jul 21 22:56:31.337366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1147/2153] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:31 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:31.448950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:31.449562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:31.456014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.456458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.457241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.457697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.589298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.597113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-37864c0d-2eeb-4e91-8f0f-1997ea2e368e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151995 Jul 21 22:56:31.597673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1007/2154] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:31.655842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:31.656445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:31.662690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.663130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.663874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:31.664303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:31.794382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:31.802832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-77f03eb9-ec01-4632-9ea8-03510835e403 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150753 Jul 21 22:56:31.803399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1148/2155] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:32.356360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:32.357008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:32.363465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.363930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.364884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.365314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.430759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.439385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.440908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.442126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e08c13f8-bac6-4414-8841-2e0d7ef69ee7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.090551 Jul 21 22:56:32.443196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1008/2156] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:32 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:32.613873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:32.614539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:32.621460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.621913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.622665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.623098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.749558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.758434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a2b97e6d-4258-432d-8519-7c374e2ee882 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148503 Jul 21 22:56:32.758988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1149/2157] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:32.819301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:32.819912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:32.826431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.826876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.827689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:32.828153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:32.956989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:32.965387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-92ad3051-3664-4449-9cac-0d63d4413b29 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150390 Jul 21 22:56:32.965948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1009/2158] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:33.461441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:33.462056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:33.468034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.468508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.469268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.469699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.533190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.541844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.543362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.544545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2e0e87d6-ca64-4f6f-8973-012c15606b20 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087739 Jul 21 22:56:33.545108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1150/2159] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:33 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:33.775372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:33.775890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:33.781936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.782381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.783157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.783588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.908929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:33.916886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-576c4fb0-d246-4651-94ad-165089fa0ba6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.145384 Jul 21 22:56:33.917452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1010/2160] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:33.982346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:33.982957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:33.989884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.990339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:33.991090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:33.991523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.118867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.126780 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c4912692-f6fb-458f-a23b-d0db65f77b4b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148347 Jul 21 22:56:34.127332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1151/2161] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:33 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:34.563063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:34.563674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:34.570223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.570668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.571437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.571868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.636319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.644833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.646975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:34.648107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-17550b50-f0e1-4472-b11e-fd944d78b89e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.089057 Jul 21 22:56:34.648680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1011/2162] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:34 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:34.933877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:34.934523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:34.940736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.941124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:34.941884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:34.943440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.069331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.077221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-58104d82-5b38-4e2c-9832-50cda8a12c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147260 Jul 21 22:56:35.077772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1152/2163] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:35.144054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:35.144706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:35.151230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.151681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.152452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.152921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.281929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.290059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd2d910c-0488-4ec0-a0de-90b028070782 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149748 Jul 21 22:56:35.290623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1012/2164] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:35 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:35.665924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:35.666610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:35.672706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.673153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.673905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:35.674334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:35.737189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.746540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.748038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:35.749222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ea334b06-edd3-479f-ad68-106c41a9947a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087252 Jul 21 22:56:35.749818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1153/2165] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:35 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:36.094356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:36.094965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:36.101952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.102397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.103187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.103618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.229834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:36.237740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a69174b2-c777-4668-8fea-f24224caa6c3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147242 Jul 21 22:56:36.238294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1013/2166] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:36.307717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:36.308352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:36.314787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.315233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.315990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.316423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.445694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:36.453641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8004ac65-2e2f-4fcd-997f-07c04f2f2285 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149821 Jul 21 22:56:36.454223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1154/2167] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:36.767449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:36.768013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:36.774669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.775130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.775894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:36.776335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:36.840088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:36.849337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:36.850874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:36.852026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8ae2f01-df43-42f2-9f06-9749d0818959 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088670 Jul 21 22:56:36.852600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1014/2168] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:36 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:37.254874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:37.255586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:37.261892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.262345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.263101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.263538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.390485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.398708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc363e1c-c406-465a-b321-73198eb3aaaf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148205 Jul 21 22:56:37.399268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1155/2169] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:37.471028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:37.471640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:37.478108 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.478553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.479304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.479732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.608363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.616755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bc67644d-e606-465c-be16-70c8db3275dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149553 Jul 21 22:56:37.617313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1015/2170] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:37 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:37.870027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:37.870584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:37.876569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.877019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.877773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:37.878209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:37.941381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.950411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.951942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:37.953114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-85b638cd-8396-4b31-8533-a0c600ff8b66 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.087107 Jul 21 22:56:37.953674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1156/2171] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:37 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:38.415480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:38.416094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:38.422254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.422694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.423449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.423879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.554461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.562494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6fbd0b38-5abf-43a6-97e4-277973c3c357 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150880 Jul 21 22:56:38.563066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1016/2172] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:38.634510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:38.635119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:38.641518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.641962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.642710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.643143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.647075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:38.775183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:38.783135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-29172037-a3d2-435c-9ea9-fa074f77cc4c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152703 Jul 21 22:56:38.783687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1157/2173] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:38.971467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:38.972008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:38.978099 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.978554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:38.979310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:38.979746 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.043945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.053112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.054610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.055748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-036f26f3-1a2a-493a-a9e0-209718812d10 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088253 Jul 21 22:56:39.056310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1017/2174] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:38 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:39.579282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:39.579896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:39.586508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.586902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.587693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.588133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.715160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.723265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42347776-7426-4d55-a6c8-d1da62d4353d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147713 Jul 21 22:56:39.724359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1158/2175] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:39.800592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:39.801748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:39.808256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.808735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.809490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:39.809919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:39.936306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:39.944851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9abcb434-802a-404e-934d-eae696f0b0e8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148073 Jul 21 22:56:39.945413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1018/2176] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:40.074120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:40.074732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:40.080740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.081190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.081949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.082394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.145624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.154001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.155521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.156702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3951eb1f-e78d-4b9a-97a5-cc5ad4f42707 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.086552 Jul 21 22:56:40.157256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1159/2177] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:40 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:40.742274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:40.742804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:40.748820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.749268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.750021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.750453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.876502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:40.885193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b833baf0-3f1a-47ac-b29e-d62e3eef9647 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147302 Jul 21 22:56:40.885750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1019/2178] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:40.962579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:40.963192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:40.969597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.970049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:40.970831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:40.971292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.099806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.107694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2fc32e9a-fda8-439b-a758-133be6d5c910 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149173 Jul 21 22:56:41.108265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1160/2179] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:40 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:41.174599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:41.175216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:41.181762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.182215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.182989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.183436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.246941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.255976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.257815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:41.258963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b155c8d8-0000-456d-8b4a-21d57732c554 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 200 len: 1445 microversion: 2.20 time: 0.088293 Jul 21 22:56:41.259524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1020/2180] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:41 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 1445 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:56:41.276684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-760dbf03-811d-4070-bab4-c0f366af193d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '.version_select at 0x7ff1d8ac1f70>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:41.298610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-760dbf03-811d-4070-bab4-c0f366af193d tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080856489" status: 204 len: 0 microversion: 2.20 time: 0.025647 Jul 21 22:56:41.299101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1161/2181] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Jul 21 22:56:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080856489 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:56:41.902088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:41.903369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:41.910141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.911325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:41.912169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:41.912849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:42.042719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:42.051534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-62ee37f7-377e-4e98-b544-df436bcebc81 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153255 Jul 21 22:56:42.052294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1021/2182] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:42.053195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-23a53034-d935-41ef-b147-f8cff4029d77 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'create', calling method: .version_select at 0x7ff1d9405790>, body: {"keypair": {"name": "tempest-keypair-2014705132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJPGZs4n3TFYNc9LopH97Ma0EUOnSoo3R9MrKbkIo/Ze+zXG8J820JwgtQzxbUZ1/YYx+GyPLnvRKbJEs8kQ06yzy8mdAXhTqShCjsoUEuRXrdk29FkWFmbDGZ7sTleig=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:42.068783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-23a53034-d935-41ef-b147-f8cff4029d77 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for project 613f21f4b5164e6087e734f9b447e961. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:56:42.072922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-23a53034-d935-41ef-b147-f8cff4029d77 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for user da46b59a0cb5430589aeef1693b2ce50 and project 613f21f4b5164e6087e734f9b447e961. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:56:42.094535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-23a53034-d935-41ef-b147-f8cff4029d77 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045269 Jul 21 22:56:42.095118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1162/2183] 10.222.0.42 () {62 vars in 1199 bytes} [Thu Jul 21 22:56:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 21 22:56:42.126356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:42.126889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:42.133198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:42.133641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:42.134400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:42.134832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:42.323277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:42.332192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-983c532e-eca0-4511-a2ab-9e7a9a2083a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.210312 Jul 21 22:56:42.333275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1022/2184] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:42 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:43.069641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.070289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.076327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.076814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.077581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.078021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.336569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.346534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d6cbb614-e5db-4514-ad2f-170648c96fd7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.281818 Jul 21 22:56:43.347103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1163/2185] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:43.357945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:43.358636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:43.366532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.366982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.367783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:43.368215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:43.370856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:43.504120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:43.513058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ec34c7d5-a10c-4a1c-91a4-46d2da68501e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.168257 Jul 21 22:56:43.513631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1023/2186] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:43.704074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-176980179", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93ef086a-5e3e-4f5f-be3b-a8a6641e9de2"}], "security_groups": [{"name": "tempest-securitygroup--472282931"}], "key_name": "tempest-keypair-2014705132", "user_data": "}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:43.803437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] validate_networks() for [('93ef086a-5e3e-4f5f-be3b-a8a6641e9de2', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:56:44.217971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:56:44.218547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:56:44.218846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:56:44.219250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:56:44.219658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:56:44.229645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.230093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.230886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.231320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.247943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for project 613f21f4b5164e6087e734f9b447e961. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:56:44.251907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Getting quotas for user da46b59a0cb5430589aeef1693b2ce50 and project 613f21f4b5164e6087e734f9b447e961. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:56:44.263362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:56:44.265616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:56:44.315005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6437bebb-1f64-4136-844b-749eb672fec6 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.615170 Jul 21 22:56:44.315655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1164/2187] 10.222.0.42 () {62 vars in 1187 bytes} [Thu Jul 21 22:56:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 22:56:44.326194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.326812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.364742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.365364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.371521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.371974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.372770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.373208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.383878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.391234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.392777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.393888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ba1cb0d4-0f6c-420d-9a7b-8821f948096b tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1281 microversion: 2.20 time: 0.071583 Jul 21 22:56:44.395268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1024/2188] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:44 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:44.508619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.517170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a93dddd4-ee72-42c5-95b7-8f7ce9b1fa15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156508 Jul 21 22:56:44.517761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1165/2189] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:44.532150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:44.532966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:44.539632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.540084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.540889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:44.541322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:44.680141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:44.688129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5cf94d92-67ef-452a-b926-f44b059ba75c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.162027 Jul 21 22:56:44.688722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1025/2190] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:44 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:45.412733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.413351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.420117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.420681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.421448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.421885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.484943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.493787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.495314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.496436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7efaf2b5-b76e-41d9-8d84-95c650b0de2a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1333 microversion: 2.20 time: 0.087697 Jul 21 22:56:45.497167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1166/2191] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:45.536439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.537086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.547175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.547698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.548602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.549291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.706492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:45.707113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:45.709179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:45.714924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.715378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.716164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:45.716633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:45.857245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.866560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a98872b0-9009-4ace-a2f4-ed5f5d11f17b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.164194 Jul 21 22:56:45.867140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1167/2192] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:45.971817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:45.979928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ca27175d-7378-424f-8396-acd61a39655d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.447878 Jul 21 22:56:45.980521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1026/2193] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:46.516840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.517449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:46.524672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.525130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.525909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.526339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.674442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.683500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.685034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:46.686293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a7692c10-bffd-42c2-bf93-49e3b895c96e tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.173588 Jul 21 22:56:46.686851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1168/2194] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:46.884993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.885616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:46.892397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.892874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.893660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:46.894092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:46.997767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:46.998388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:47.004375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.005099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.005881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.006499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.121606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.139143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb63e548-75e3-4669-a6a1-eb5a8eab5862 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.258051 Jul 21 22:56:47.140297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1027/2195] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:47.165769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.174672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-282a0c70-6e9c-46c6-949a-b759aac2f2b9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.181515 Jul 21 22:56:47.175253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1169/2196] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:47.359387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-e5947812-95ab-40bf-8ccc-6dd99707da5a req-732707f1-ca0e-406d-8497-992da3b6fc7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb189ff-56e0-4d7d-b194-05f2ac1d6e66", "tag": "d3e6c79b-ab56-4bd3-8796-f4941fd75f1a"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:47.368945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e5947812-95ab-40bf-8ccc-6dd99707da5a req-732707f1-ca0e-406d-8497-992da3b6fc7e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.369574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e5947812-95ab-40bf-8ccc-6dd99707da5a req-732707f1-ca0e-406d-8497-992da3b6fc7e service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.381937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-e5947812-95ab-40bf-8ccc-6dd99707da5a req-732707f1-ca0e-406d-8497-992da3b6fc7e service nova] Creating event network-changed:d3e6c79b-ab56-4bd3-8796-f4941fd75f1a for instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 on hv-cinder-85069 Jul 21 22:56:47.387272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-e5947812-95ab-40bf-8ccc-6dd99707da5a req-732707f1-ca0e-406d-8497-992da3b6fc7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114088 Jul 21 22:56:47.388039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1028/2197] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:47.705455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:47.706014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:47.713069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.713518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.714271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:47.714699 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:47.846382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.854774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.856291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:47.857444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-750fae06-0f03-4b9b-9065-609eb226c69a tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.156035 Jul 21 22:56:47.857999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1170/2198] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:47 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:48.157434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.158143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.165002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.165452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.166223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.166665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.191033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.192112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.198071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.198519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.199348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.199813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.299674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:48.308200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bac69bb7-70b9-40de-8486-beeff186486a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155407 Jul 21 22:56:48.308805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1029/2199] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:48.340484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:48.348406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d8a5a3ed-930b-4e77-9d71-2b27689b5877 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.161186 Jul 21 22:56:48.348987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1171/2200] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:48.875759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:48.876516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:48.883103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.883579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:48.884348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:48.884836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.098397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.106357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.107871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.109011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dad04673-8fde-4a93-9766-da0c51688f08 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.237203 Jul 21 22:56:49.109563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1030/2201] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:48 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:49.325982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:49.326598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:49.334104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.334630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.335395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.335831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.365744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:49.366336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:49.372644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.373096 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.374085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:49.374534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:49.470291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.478400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3dca07ee-5eed-4b0b-9c98-740ecdf2954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156403 Jul 21 22:56:49.488106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1172/2202] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:49 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:49.507367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:49.515329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f30798a4-7564-40fe-9efb-054b8babc92d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154019 Jul 21 22:56:49.515890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1031/2203] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:50.127126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.127739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.135022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.135472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.136230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.136694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.265074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.273249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.274776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.275892 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf2e5819-997d-4767-a5fd-ae51a151106c tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.152807 Jul 21 22:56:50.276456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1173/2204] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:50.495537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.496147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.502587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.503031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.503785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.505056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.532179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:50.532822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:50.539832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.540281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.541065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:50.541502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:50.638565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.646665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-88d9a5b2-a87f-4025-8e81-87c6bc82a6ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154928 Jul 21 22:56:50.647244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1032/2205] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:50.674227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:50.682803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bdb0233d-06a3-47a3-9bee-237eb8867566 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154412 Jul 21 22:56:50.683305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1174/2206] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:51.292727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.293350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.299413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.299864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.300669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.302299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.435010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.443266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.444821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.445923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6e480c11-3082-49be-8f6b-86c3e2c9c8ff tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.157178 Jul 21 22:56:51.446474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1033/2207] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:51.664576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.665107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.671577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.672030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.672857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.673303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.699007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:51.699729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:51.706061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.706518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.707848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:51.708293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:51.814363 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.822516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5fd9faca-55a2-4672-949f-5a4a73fcf4c6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.162421 Jul 21 22:56:51.823094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1175/2208] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:51.844658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:51.853162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ad19d532-bd90-454e-b044-48338bc894f6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157908 Jul 21 22:56:51.853730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1034/2209] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:52.463618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:52.464216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:52.470201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.470641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.471407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.471818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.486718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:52.601589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.609542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.611094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.612217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9a2a1fed-6bd4-4693-ad37-5747bf1e96c1 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.152636 Jul 21 22:56:52.612820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1176/2210] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:52 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:52.839087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:52.839725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:52.842208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=82 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:52.847442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.848380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.849162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.849591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.870370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:52.871134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:52.877569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.878015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.879035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:52.879234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:52.986158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:52.994315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d753cb48-0782-4e38-9166-d134f450fb4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.159063 Jul 21 22:56:52.994901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1035/2211] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:53.010382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.018272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3f40d7b1-5ff8-4b9a-b3df-68ec463840d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151730 Jul 21 22:56:53.018829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1177/2212] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:53.235887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-5d470f3e-b573-47fc-9838-b00e6fa3e8d4 req-55715feb-dc3f-4e9f-9d68-b63b26ab86aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb189ff-56e0-4d7d-b194-05f2ac1d6e66", "name": "network-vif-plugged", "status": "completed", "tag": "d3e6c79b-ab56-4bd3-8796-f4941fd75f1a"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:53.244828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-5d470f3e-b573-47fc-9838-b00e6fa3e8d4 req-55715feb-dc3f-4e9f-9d68-b63b26ab86aa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:53.245281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-5d470f3e-b573-47fc-9838-b00e6fa3e8d4 req-55715feb-dc3f-4e9f-9d68-b63b26ab86aa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:53.257067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-5d470f3e-b573-47fc-9838-b00e6fa3e8d4 req-55715feb-dc3f-4e9f-9d68-b63b26ab86aa service nova] Creating event network-vif-plugged:d3e6c79b-ab56-4bd3-8796-f4941fd75f1a for instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 on hv-cinder-85069 Jul 21 22:56:53.261972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-5d470f3e-b573-47fc-9838-b00e6fa3e8d4 req-55715feb-dc3f-4e9f-9d68-b63b26ab86aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084563 Jul 21 22:56:53.262558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1036/2213] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:53.630442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:53.631045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:53.637229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:53.637670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:53.638415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:53.638845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:53.765774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.773806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.775316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:53.776420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-08fc6426-682d-426a-8dce-21f4a6dc01d9 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.149933 Jul 21 22:56:53.777006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1178/2214] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:53 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:54.014229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:54.014962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:54.021965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.022419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.023193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.023627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.036169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:54.036893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:54.043842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.044366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.045167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.045608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.156650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:54.164767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-41217c93-88fe-449f-82e4-7dd1f7a8bdfc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155975 Jul 21 22:56:54.165336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1037/2215] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:54 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:54.184094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:54.191967 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1f8afc4e-b1f1-4195-bc5d-7c5680197e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159713 Jul 21 22:56:54.192530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1179/2216] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:54.794449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:54.795068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:54.797253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:54.802980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.803460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.804428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:54.804883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:54.935422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:54.943723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:54.945302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:54.946403 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e15715a0-2aeb-45a6-b6cf-9c06be8d8ed8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1406 microversion: 2.20 time: 0.155861 Jul 21 22:56:54.946952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1038/2217] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:54 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:55.181090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:55.181692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:55.183555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:55.184151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=10 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:55.190668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.191109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.191855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.192284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.208680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:55.209892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:55.216248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.216739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.217496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.217934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.343752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:55.351448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-323611bc-30d9-4027-b8b0-a03b140f5b35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.174201 Jul 21 22:56:55.352034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1180/2218] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:55.374292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:55.383733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fefd37ce-883a-4004-b056-47e9d017d16b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.178859 Jul 21 22:56:55.384312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1039/2219] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:55.964072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:55.964682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:55.970703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.971144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:55.971890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:55.972316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.102638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.110507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.112007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.113195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8bd112fb-430e-4424-b5a1-0289d1dccd46 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1599 microversion: 2.20 time: 0.153151 Jul 21 22:56:56.113751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1181/2220] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:56:55 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:56:56.131073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:56.131875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:56.137860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.138310 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.139073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.139516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.220013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-db66626f-d2ea-41d2-aec4-e307a33b88f7 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093319 Jul 21 22:56:56.220631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1040/2221] 10.222.0.42 () {60 vars in 1315 bytes} [Thu Jul 21 22:56:56 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:56:56.369253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:56.369870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:56.376299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.376781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.377532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.377959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.401439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:56.402308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:56.408390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.408948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.409881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:56.410836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:56.512290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.520738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-20b198bd-f1ac-4849-afd7-a94facf9f383 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155721 Jul 21 22:56:56.521019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1182/2222] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:56.673474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:56.681554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-46af07d9-05ae-4ac8-9656-e191c19325a3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.284007 Jul 21 22:56:56.682136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1041/2223] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:57.228099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-9dfe3899-07e4-406b-bede-212ee713206d req-542bd3d9-5a72-4513-b89b-30d1d1c00f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb189ff-56e0-4d7d-b194-05f2ac1d6e66", "tag": "d3e6c79b-ab56-4bd3-8796-f4941fd75f1a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:56:57.236236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-9dfe3899-07e4-406b-bede-212ee713206d req-542bd3d9-5a72-4513-b89b-30d1d1c00f30 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.236781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-9dfe3899-07e4-406b-bede-212ee713206d req-542bd3d9-5a72-4513-b89b-30d1d1c00f30 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.248597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-9dfe3899-07e4-406b-bede-212ee713206d req-542bd3d9-5a72-4513-b89b-30d1d1c00f30 service nova] Creating event network-changed:d3e6c79b-ab56-4bd3-8796-f4941fd75f1a for instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 on hv-cinder-85069 Jul 21 22:56:57.253701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-9dfe3899-07e4-406b-bede-212ee713206d req-542bd3d9-5a72-4513-b89b-30d1d1c00f30 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029790 Jul 21 22:56:57.254289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1183/2224] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:56:57.540063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:57.541448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:57.548275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.549249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.549555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.550645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.569029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:56:57.701180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:57.701897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:57.708368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.708895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.709795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:57.710230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:57.863863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.874030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bccc053b-d374-4791-b565-807c891bdd86 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.177441 Jul 21 22:56:57.884781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1184/2225] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:56:57.892464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:57.901377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-231067f4-76d5-40c8-b5f8-a1a7ff5b2536 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.365993 Jul 21 22:56:57.902172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1042/2226] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:58.891797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:58.892400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:58.898979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.899423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.900170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.900628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.919159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:56:58.919766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:56:58.926222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.926663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:58.928438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:56:58.928896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:56:59.028033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.035972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-345e5ce0-a2ad-4480-9440-f61314a34e6a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147970 Jul 21 22:56:59.036566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1185/2227] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:56:59.062021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:56:59.070608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fa720f7f-beab-4e26-a244-b3fcff035d0f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155244 Jul 21 22:56:59.071166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1043/2228] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:56:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:00.053492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:00.054096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:00.060758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.061221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.061969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.062407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.088219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:00.088861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:00.095442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.095895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.096694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:00.097133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:00.197815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:00.205837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be17e1df-af5b-4853-93cd-0b194d45ada1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156207 Jul 21 22:57:00.206407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1186/2229] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:00.233582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:00.241515 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c22d6e0e-2a71-4414-8ad5-e80efbb637b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.158244 Jul 21 22:57:00.242076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1044/2230] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:01.224702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:01.225401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:01.232102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.232581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.233348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.233785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.259233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:01.260016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:01.266495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.266951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.267724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:01.268156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:01.369485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.377450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-44608678-8706-484a-b048-b09f43aefae9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.158204 Jul 21 22:57:01.378245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1187/2231] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:01.498550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:01.507468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de1059fd-4480-4208-89f8-9aa98d51b60e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.252839 Jul 21 22:57:01.508044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1045/2232] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:02.394632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:02.395217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:02.401732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.402176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.402930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.403356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.524800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:02.525454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:02.531942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.532397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.533204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:02.533410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.533650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:02.542183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-873f3706-0a31-4383-bb63-fb161dd2937c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151399 Jul 21 22:57:02.542769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1188/2233] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:02.661346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:02.669957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8093f656-6ddd-443b-a0ed-a80d137d16a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149448 Jul 21 22:57:02.670520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1046/2234] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:02 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:03.558841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:03.559448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:03.565944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.566385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.567135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.567563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.687988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:03.688695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:03.696171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.697316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.697477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:03.697899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:03.727934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:03.736426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b7ec80f4-0d57-4173-8126-9b9c2aa50b97 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.181396 Jul 21 22:57:03.737039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1189/2235] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:03.857475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:03.868459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6615d7ca-99bc-4f38-9acc-cf52b8f9c0aa tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.184922 Jul 21 22:57:03.869455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1047/2236] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:04.758665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:04.759313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:04.765735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.766172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.766917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.767345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.886922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:04.887573 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:04.894143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.894611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.895368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:04.896450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:04.898545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:04.906470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac591834-3bfd-4122-900a-2bfce4a8fff0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152429 Jul 21 22:57:04.907090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1190/2237] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:05.025524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:05.033283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2c031e93-9511-45aa-9aeb-9c584cdea9ad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150224 Jul 21 22:57:05.033839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1048/2238] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:05.923052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:05.923659 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:05.930376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.930824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:05.931569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:05.931999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.050327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:06.050946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:06.057451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.057911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.058262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:06.058688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:06.059131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:06.066169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-126b9491-1675-4245-ba52-652806537e39 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147009 Jul 21 22:57:06.066734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1191/2239] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:06.189946 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:06.198974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-12eac630-abd3-4f74-8ff1-c15ef5abe894 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152364 Jul 21 22:57:06.199873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1049/2240] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:07.083723 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:07.084376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:07.090987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.091438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.092218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.092683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.217168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:07.217775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:07.223579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:07.225136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.225582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.226346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:07.226780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:07.232378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-54cef3d9-b7bd-4a67-a31e-1b6a830e4d15 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153090 Jul 21 22:57:07.232976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1192/2241] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:07.358747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:07.367199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cb7bcbb0-4f79-486b-9959-043fb2b843c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154109 Jul 21 22:57:07.367761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1050/2242] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:08.250245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:08.250782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:08.258309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.258762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.259526 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.259963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.385616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:08.386283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:08.388835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:08.391141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:08.393350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.393808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.394668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:08.395105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:08.398289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-666a177b-0518-44dd-930a-9600539ed631 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151997 Jul 21 22:57:08.398869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1193/2243] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:08.524835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:08.532673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2f11eca-2663-4927-b565-57faa6365da9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152299 Jul 21 22:57:08.533232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1051/2244] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:08 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:09.415317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:09.415939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:09.422665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.423113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.423881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.424314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.550567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:09.551181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:09.556548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:09.557834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.558276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.559039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:09.559472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:09.564629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-175466b9-9b5e-43c6-aefb-e3612f2cc6cb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153422 Jul 21 22:57:09.565189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1194/2245] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:09.690625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:09.699047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6f0e7d2a-f2c5-4bb8-9303-59e227caa762 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152739 Jul 21 22:57:09.699610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1052/2246] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:10.582455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:10.583067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:10.589812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.590256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.591009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.591437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.716073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:10.716750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:10.718305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:10.723525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.724750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.725544 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:10.725975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:10.726689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-596fe2c4-ee09-43ef-a77f-7fae9d5c3ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148138 Jul 21 22:57:10.727249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1195/2247] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:10.860831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:10.869289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2ec7c7d4-ae10-42b4-8042-fc19d15e43b9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.157053 Jul 21 22:57:10.869851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1053/2248] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:10 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:11.743556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:11.744206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:11.751958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.752572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.753420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.753943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.887235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:11.887973 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:11.893250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:11.894948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.895571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.897641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:11.898095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:11.901727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8b2849ea-0b5d-46b6-bc94-5935e38b5065 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.162327 Jul 21 22:57:11.903762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1196/2249] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:12.028941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:12.036873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a0621cf6-cfd4-4fc9-adef-2b2d9e1a1d67 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153353 Jul 21 22:57:12.037439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1054/2250] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:11 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:12.920342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:12.920980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:12.927408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.927855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:12.929237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:12.929680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.053852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:13.054465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:13.055945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:13.060945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.061392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.062153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:13.062583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:13.064225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c051135b-75e0-4186-bde6-c2ccd57124cc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147765 Jul 21 22:57:13.065020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1197/2251] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:13.192427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:13.200848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c27d716b-8139-4db7-8340-6db9a8088034 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150857 Jul 21 22:57:13.201416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1055/2252] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:13 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:14.081950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:14.082558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:14.089579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.090024 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.090822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.091246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.218695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:14.219174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:14.219302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:14.226465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.226908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.227668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:14.227774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c06d7e5b-59dc-494a-a464-ffa7bfb067d3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149644 Jul 21 22:57:14.228098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:14.228598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1198/2253] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:14.356366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:14.364268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-75826f90-0d8e-46f6-a1bc-eef491e537b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149559 Jul 21 22:57:14.364871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1056/2254] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:15.245391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:15.245983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:15.252459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.252928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.253673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.254102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.381739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:15.382368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:15.386606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:15.389046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.389502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.390275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:15.390709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:15.394615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-77c8b63e-219f-44a2-8b90-da91e2307114 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153811 Jul 21 22:57:15.395406 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1199/2255] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:15.540130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:15.548420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7f312561-d80a-4c94-812e-dbf40d3d441f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.171062 Jul 21 22:57:15.549039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1057/2256] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:15 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:16.412147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:16.412880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:16.415318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=66 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:16.420539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.420984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.421737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.422163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.548741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:16.557318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-effefe92-a068-4ff5-835e-17b3cdc7bce9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148996 Jul 21 22:57:16.557885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1200/2257] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:16.566401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:16.567026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:16.574032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.574496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.575256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:16.575696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:16.701317 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:16.709655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d1989848-b4b2-4c25-a6f7-e7fc34642ec3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146914 Jul 21 22:57:16.710230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1058/2258] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:17.574193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:17.574798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:17.581290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.581735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.582480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.582906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.711973 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:17.719820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a1e34fb3-efc8-4954-9079-2318000f8017 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149492 Jul 21 22:57:17.720384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1201/2259] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:17.727331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:17.727942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:17.734333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.734780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.735528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:17.735966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:17.739805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:17.867351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:17.875322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2da2d37c-38e8-4eb0-9cc1-84e3ebd8fbcc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152333 Jul 21 22:57:17.875882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1059/2260] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:17 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:18.736740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:18.737281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:18.743933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.744390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.745176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.745615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.872157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:18.880122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e75809f8-a0be-4c5e-be49-7973a18b06d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147381 Jul 21 22:57:18.880734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1202/2261] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:18.892739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:18.893353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:18.900268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.900749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:18.901504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:18.901933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.036184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:19.044388 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-54b5acaa-d010-4c97-9d3c-c7c4ca13e1d8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155552 Jul 21 22:57:19.044986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1060/2262] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:18 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:19.897980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:19.898604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:19.905114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.905561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:19.906345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:19.906778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:20.034332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:20.042822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9ea71247-b888-4690-baca-9cc048634edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149395 Jul 21 22:57:20.043392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1203/2263] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:20.061688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:20.062283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:20.069324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:20.069950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:20.070696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:20.071128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:20.199094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:20.207023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7b1f62af-3137-47b2-b48d-8c7efab86250 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149234 Jul 21 22:57:20.207589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1061/2264] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:21.059946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:21.060587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:21.067041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.067489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.068878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.069429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.203508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:21.211707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-be466d90-37d7-4378-8a6a-d72ee5d6f0ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155588 Jul 21 22:57:21.212273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1204/2265] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:21.223934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:21.225161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:21.231562 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.232005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.232783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:21.233219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:21.367662 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:21.375498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de6b4e47-319c-495a-9884-a811161639de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155365 Jul 21 22:57:21.376054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1062/2266] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:21 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:22.228662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:22.229281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:22.235813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:22.236265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:22.237057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:22.237591 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:22.364946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:22.373230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-13e00b04-a35c-4b81-b9d7-3dd2398203a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149015 Jul 21 22:57:22.373793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1205/2267] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:22.392606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:22.393225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:22.400185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:22.400660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:22.401452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:22.402006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:22.529415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:22.538143 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f94e4ff-947a-4e9c-9c71-0fe5242e696d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148675 Jul 21 22:57:22.538707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1063/2268] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:23.390813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:23.391424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:23.398367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.398818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.399577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.400011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.531865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:23.540676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-13a02e6f-27d9-4de0-a8d1-934df5fbfb99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153678 Jul 21 22:57:23.541243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1206/2269] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:23.555406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:23.556018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:23.558383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=58 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:23.563539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.563983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.564777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:23.565210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:23.696431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:23.704336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-257e03a2-5a3b-48df-92cd-a06de89b8541 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153279 Jul 21 22:57:23.704927 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1064/2270] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:24.558325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:24.558935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:24.565520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.566019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.566770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.567204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.695455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:24.705437 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-990589ac-e95d-4707-955b-9373838100ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150944 Jul 21 22:57:24.706023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1207/2271] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:24.721792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:24.722411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:24.729153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.729608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.730372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:24.730820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:24.860252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:24.868797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-353dc131-43e1-4742-af32-23a5b13b05ec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150817 Jul 21 22:57:24.869370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1065/2272] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:24 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:25.722209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:25.722817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:25.729672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.730120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:25.730875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.731315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:25.860968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:25.868886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ff5e8247-66f4-4a0e-bfc2-b782f2dd91fb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150521 Jul 21 22:57:25.869442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1208/2273] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:25.886219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:25.886829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:25.893344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.893778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:25.894534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:25.894965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.022639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:26.030558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c1f7efd8-dcbc-4c83-973b-bc13a295f343 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148108 Jul 21 22:57:26.031119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1066/2274] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:25 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:26.886052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:26.886666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:26.893358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.893812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:26.894626 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:26.895069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:27.028641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:27.036642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3da6609b-d3d3-46a5-a52f-be05f1a39e37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154461 Jul 21 22:57:27.037300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1209/2275] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:27.047490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:27.048224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:27.055194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:27.055647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:27.056440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:27.056906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:27.189395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:27.197727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de6745e6-fcfe-4c6b-98f6-afce7ae5d0bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154008 Jul 21 22:57:27.198308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1067/2276] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:27 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:28.053607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:28.054210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:28.060650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.061094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.061839 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.062270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.077200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:28.189480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:28.197981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b4e12721-a839-4251-baab-05e2991fccae tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148187 Jul 21 22:57:28.198543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1210/2277] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:28.215246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:28.215861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:28.221997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.222434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.223195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:28.223636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:28.350663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:28.358565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-525ba325-53a8-4f0a-ba6e-a20fddd5f2ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147196 Jul 21 22:57:28.359139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1068/2278] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:28 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:29.214945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:29.215546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:29.221941 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.222382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.223133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.223557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.352362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:29.360200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1e23261a-7911-46de-801a-0d0481677752 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149100 Jul 21 22:57:29.360794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1211/2279] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:29.375132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:29.375747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:29.383207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.383658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.384418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:29.384878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:29.516822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:29.525021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ddd75c84-b239-4a1f-9d0b-99322f9f817e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153798 Jul 21 22:57:29.525592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1069/2280] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:30.377687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:30.378295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:30.386221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.386675 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.387459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.387894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.518345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:30.527560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ba930dab-9e82-468e-ae87-6ac970d96356 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153728 Jul 21 22:57:30.528124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1212/2281] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:30.541582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:30.542190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:30.548598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.549061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.549795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:30.550229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:30.678826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:30.686785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-60839f27-8f13-4c1a-b29e-1f9f1e5304d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149023 Jul 21 22:57:30.687357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1070/2282] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:30 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:31.544543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:31.545154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:31.551752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.552356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.553150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.553587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.682801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:31.690683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-61f287ab-1a98-4dfb-a8cc-6f32fb38898a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150059 Jul 21 22:57:31.691236 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1213/2283] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:31.704982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:31.705784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:31.714291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.714749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.715590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:31.716035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:31.853619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:31.861588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d9eacbe-c41b-45be-9dbc-6fe2328f52ee tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.160497 Jul 21 22:57:31.862154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1071/2284] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:32.707290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:32.707811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:32.714308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.714759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.715519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.715958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.841942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:32.850123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6b7e03b-e9b6-4970-9409-79dbb3ddbe14 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146831 Jul 21 22:57:32.850686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1214/2285] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:32.878416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:32.879026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:32.886457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.886903 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:32.887655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:32.888087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:33.016375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:33.024287 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-73d496b2-4503-4264-8f6e-f4719f6452c8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149670 Jul 21 22:57:33.024877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1072/2286] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:33.443534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:33.444032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:33.450037 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.450520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:33.451281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.451719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:33.474578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d53e9e89-988b-42da-91c8-ef83f614af30 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66/ips" status: 200 len: 152 microversion: 2.20 time: 0.034603 Jul 21 22:57:33.475138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1215/2287] 10.222.0.42 () {60 vars in 1288 bytes} [Thu Jul 21 22:57:33 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66/ips => generated 152 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:57:33.867547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:33.868165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:33.874513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.874905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:33.875663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:33.876095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:34.004823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:34.013761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a5b590c0-2153-4c66-951b-3258ad692c07 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150175 Jul 21 22:57:34.014367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1073/2288] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:34.041157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:34.041805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:34.048247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:34.048732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:34.049491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:34.049927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:34.180539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:34.188376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-61f3d563-ddfe-4336-90c2-eb971b492ffd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151642 Jul 21 22:57:34.188962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1216/2289] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:34 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:35.030773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:35.031321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:35.038692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.039145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.039904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.040339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.173542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:35.181841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-eb9ee55b-d447-44c2-af33-035c26d28c02 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155043 Jul 21 22:57:35.182414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1074/2290] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:35.206146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:35.206777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:35.213872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.214320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.215076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:35.215512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:35.344726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:35.353238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-41b4ecf8-a7bb-475d-84c9-aabc5343c077 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150918 Jul 21 22:57:35.353797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1217/2291] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:35 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:36.198649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:36.199258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:36.205821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.206275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.207039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.207478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.334646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:36.336826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:36.343556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de0ad681-028c-41f1-b851-1035ce9b53bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148772 Jul 21 22:57:36.344126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1075/2292] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:36.370899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:36.371992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:36.378721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.379166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.379928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:36.380940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:36.507776 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:36.515664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b0a3af7d-1e86-4230-a581-c0babf9b69c4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148814 Jul 21 22:57:36.516220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1218/2293] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:37.361304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:37.361909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:37.368995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.369435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.370283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.370608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.501312 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:37.510104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3ffb0b88-4943-49e4-a6e6-f228108ab911 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152890 Jul 21 22:57:37.510669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1076/2294] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:37.531411 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:37.532023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:37.538604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.539054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.539811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:37.540246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:37.671894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:37.680424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2ddeed6d-851a-4618-a29d-bbceedb8f820 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152827 Jul 21 22:57:37.681020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1219/2295] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:37 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:38.529135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:38.529742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:38.536227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.536811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.537561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.537995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.664314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:38.672205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-edc822ba-eaab-4ce3-8187-a85f074ca05a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147065 Jul 21 22:57:38.672792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1077/2296] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:38.697708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:38.698316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:38.704740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.705189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.705936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:38.706364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:38.831106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:38.839549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0303aeec-d1fe-492b-9b9e-a951b3fdaae1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145721 Jul 21 22:57:38.840129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1220/2297] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:39.689321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:39.689857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:39.696407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.696881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.697627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.698060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.825352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:39.833786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18692fff-a6b1-48c6-b109-8c2fc787e6dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147825 Jul 21 22:57:39.834377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1078/2298] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:39.856502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:39.857118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:39.863508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.863952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.865189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:39.865621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:39.994843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:40.002874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d7edb4ff-cf87-45fd-9aa4-d109409f63a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150150 Jul 21 22:57:40.003436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1221/2299] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:40.850321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:40.850936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:40.857418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:40.857872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:40.858634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:40.859075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:40.993825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:41.001817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5802ef5e-b280-4b99-aaab-5a3b022b378c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155347 Jul 21 22:57:41.002383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1079/2300] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:41.019013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:41.019629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:41.026725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:41.027177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:41.027940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:41.028380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:41.153893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:41.161779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c7cbb2c1-2eea-426b-a3ec-6d81e3c05d07 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146607 Jul 21 22:57:41.162341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1222/2301] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:41 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:42.019022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:42.019621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:42.026321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.026766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.027519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.027985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.161697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:42.169801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-df950a7a-b6d9-4a35-a91f-b6152880f962 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154603 Jul 21 22:57:42.170364 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1080/2302] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:42.179397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:42.180008 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:42.186065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.186505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.187248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:42.187679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:42.311525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:42.320007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-75d6cb88-f2bb-4e7f-a3ce-391a73cd4dce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145404 Jul 21 22:57:42.320592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1223/2303] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:42 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:43.187285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:43.187900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:43.194876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.195327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.196085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.196548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.326505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:43.334525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-84d63694-d182-4a95-b3b8-bb91640f32d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151062 Jul 21 22:57:43.335089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1081/2304] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:43.337220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:43.337838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:43.344297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.344778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.345528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:43.345956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:43.476338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:43.484259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1158e314-2f0e-4901-8a1c-634059164bef tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151340 Jul 21 22:57:43.484863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1224/2305] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:44.351243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:44.352499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:44.359005 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.359451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.360211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.360682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.488442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:44.496861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9b66d40a-b7bb-4100-8f74-2231a7082951 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149520 Jul 21 22:57:44.497424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1082/2306] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:44.501601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:44.502210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:44.509436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.509882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.510637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:44.511071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:44.637726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:44.646232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-855a1b2e-6661-462b-bd4c-071ba11b1d8d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147894 Jul 21 22:57:44.646788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1225/2307] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:44 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:45.514872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:45.515491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:45.522389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.522838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.523596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.524031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.656313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:45.663682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:45.664284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:45.665692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2cbcccd2-dbba-4730-a4e7-e9dac218c82b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154628 Jul 21 22:57:45.666269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1083/2308] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:45.670691 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.671140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.671893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:45.672321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:45.808905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:45.816887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c84259b-3c25-4d34-98f8-c70cff0dc143 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.157699 Jul 21 22:57:45.817643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1226/2309] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:46.683401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:46.683944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:46.690630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.691079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.691835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.692274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.820974 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:46.829058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ebee4fc0-ca19-4419-b0f2-0c005c0d8b04 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149539 Jul 21 22:57:46.829652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1084/2310] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:46.834030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:46.834655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:46.837077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=54 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:46.842343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.842785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.843574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:46.844004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:46.859055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:46.969963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:46.978497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f245d911-d615-47db-8afa-8e26e4e573a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148743 Jul 21 22:57:46.979048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1227/2311] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:47.845942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:47.846589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:47.853479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:47.853933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:47.854697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:47.855138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:47.981297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:47.989688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5f6d2cc2-72a4-4d00-8037-397726db0b54 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147111 Jul 21 22:57:47.990272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1085/2312] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:47.996282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:47.996938 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:48.003418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:48.003868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:48.005316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:48.005787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:48.133325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:48.141284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1a5f70ef-d8f7-464b-ac7f-e3eba7d17283 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148786 Jul 21 22:57:48.141850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1228/2313] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:47 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:49.007814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:49.008428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:49.014955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.015412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.016174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.016654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.147406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:49.155352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4af4222e-dcfc-46d7-af1c-81ba99e2aaea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152362 Jul 21 22:57:49.155918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1086/2314] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:49.158846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:49.159481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:49.166362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.166804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.167550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:49.167982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:49.298041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:49.306556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6734b894-bb79-465c-adfe-f5515643d7ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151622 Jul 21 22:57:49.307132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1229/2315] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:49 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:50.172178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:50.172821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:50.179915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.180394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.181182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.181622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.310420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:50.319272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00e8fd36-80b1-4720-9efb-37fa60ef776d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151039 Jul 21 22:57:50.319848 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1087/2316] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:50.323809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:50.324436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:50.330644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.331094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.331854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:50.332290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:50.459542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:50.467482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-040675d3-3877-4379-b1e6-ce292bf95745 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147562 Jul 21 22:57:50.468050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1230/2317] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:51.336945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.337554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.344255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.344733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.345483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.345914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.477882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:51.484423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:51.485298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:51.486483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0f69f61f-a8ce-4212-845c-fa54585afc37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153630 Jul 21 22:57:51.487051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1088/2318] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:51.493089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.493879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.495122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:51.495931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:51.626059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:51.634590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d31882f9-c562-49f5-be80-f27eca5724e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153956 Jul 21 22:57:51.635165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1231/2319] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:51 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:52.503776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.504401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.511374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.511833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.512623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.513056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.638928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:52.647334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b7c7001e-4694-4170-8b9f-cf857af45031 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147392 Jul 21 22:57:52.647882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1089/2320] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:52.652079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:52.652725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:52.659186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.659638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.660410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:52.661528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:52.788584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:52.796387 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c83f253-a1a0-408e-9797-b935e1770b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148216 Jul 21 22:57:52.796975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1232/2321] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:53.664111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.664682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.666924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:53.672148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.672619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.673372 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.673805 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.803306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:53.811157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6b938d79-ad2b-4589-ba64-870220c74192 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151063 Jul 21 22:57:53.811723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1090/2322] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:53.813752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:53.814402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:53.821619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.822070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.822837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:53.823274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:53.953184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:53.961150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a95fc8f1-90ea-481b-8602-2b4c4a51dac8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151188 Jul 21 22:57:53.961700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1233/2323] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:53 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:54.828763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.829379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.836426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.836938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.837701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.838138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.970128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:54.977832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:54.978346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-acd73bde-7ac2-446b-a08f-a7eadc3fe795 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153270 Jul 21 22:57:54.978483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:54.978716 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1091/2324] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:54.984773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.985246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:54.985997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:54.986425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:55.112579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:55.120469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d9635707-a2c0-4e48-99b3-267d416213b3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146391 Jul 21 22:57:55.121045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1234/2325] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:54 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:55.995561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:55.996174 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.002626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.003074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.003831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.004290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.019161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:57:56.131450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:56.138087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:56.138705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:56.139665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d27aac5-8d68-42b2-abe0-a0c01e1db034 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147937 Jul 21 22:57:56.140241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1092/2326] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:56.145610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.146058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.146823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:56.147274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:56.274510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:56.282414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2a96ffab-085b-4436-b3ae-8101f0d007c5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148160 Jul 21 22:57:56.282982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1235/2327] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:57.157305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:57.157916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:57.165234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.165681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.166431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.166864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.295932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.298946 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:57.299556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:57.304749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-01cb4c04-bbcc-458e-9e87-a33981f21191 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151173 Jul 21 22:57:57.312551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1093/2328] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:57.312726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.312726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.312726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:57.312726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:57.437619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:57.446507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-daf2d46c-5dd4-4297-b5df-2739345a07e9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151326 Jul 21 22:57:57.447061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1236/2329] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:57:58.321911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:58.322516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:58.328992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.329436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.330186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.330623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.461611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.463540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:58.464157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:58.469769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b19ebbc1-c84f-42cf-9aa8-0159c865b7a2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151753 Jul 21 22:57:58.470341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1094/2330] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:58.470802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.471255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.472021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:58.472454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:58.601522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:58.609420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1aed72d3-e4e9-482e-b1ff-a580b6ad0a11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149667 Jul 21 22:57:58.609980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1237/2331] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:59.487150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:59.487771 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:59.494301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.494756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.495524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.495964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.625101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:59.626858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:57:59.627413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:57:59.634460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-84e2939e-15ea-44b4-b65d-33d4f71675b5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150996 Jul 21 22:57:59.635043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1095/2332] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:57:59.635162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.635590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.636360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:57:59.636827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:57:59.766237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:57:59.774223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6c63160-be72-4d69-87ee-aed61f58db11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151258 Jul 21 22:57:59.774796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1238/2333] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:57:59 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:00.651197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:00.651804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:00.658535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.658994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.659796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.660237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.787593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.791291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:00.791904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:00.795497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-69e9613e-a30f-4293-9491-cb82bbee2b01 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148180 Jul 21 22:58:00.796059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1096/2334] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:00.798329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.798843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.799606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:00.800039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:00.927824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:00.935771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a487669f-c079-4b0c-aafa-a5dd41cc1e9e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148429 Jul 21 22:58:00.936334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1239/2335] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:01.813116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:01.813731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:01.820988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.821439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.822202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.822639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.952835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:01.953283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:01.953998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:01.961093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.961341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ebf67a36-4b2e-4ecd-bb88-743d68311597 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152137 Jul 21 22:58:01.961683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:01.961909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1097/2336] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:01.962513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:01.962957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.088074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:02.095933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70a23719-4ed2-48f6-ba62-5e8f77697988 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146841 Jul 21 22:58:02.096512 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1240/2337] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:02.978671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:02.979311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:02.985717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.986161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:02.986914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:02.987346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:03.113397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:03.114431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:03.116761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:03.120872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:03.121324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:03.122085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:03.122514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:03.124585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9bfeeb85-40b0-4e51-9dfa-15e69122c348 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149717 Jul 21 22:58:03.125159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1098/2338] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:03.463138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:03.470971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7c8f2dee-d849-4ce2-ac27-e99370da20ce tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.361468 Jul 21 22:58:03.471528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1241/2339] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:04.141648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:04.142254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:04.148823 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.149272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.150021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.150455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.280846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:04.289583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-44909e84-bd08-4bae-ab80-e817c1976c30 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151812 Jul 21 22:58:04.290148 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1099/2340] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:04.488547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:04.489156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:04.495524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.495963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.496752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:04.497182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:04.625134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:04.633561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e0934cf0-d171-4ad7-a4df-ba9d39b01c71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148835 Jul 21 22:58:04.634122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1242/2341] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:05.307112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:05.307722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:05.314213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.314655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.315404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.315832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.463808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:05.471846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63d5eb53-0cc2-492a-8a1a-3d35b53b7cf8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.168564 Jul 21 22:58:05.472463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1100/2342] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:05.650426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:05.651148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:05.658794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.659247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.660014 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:05.660441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:05.802001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:05.810739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-514149b7-d71f-4977-bc17-218a85e75f64 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.164245 Jul 21 22:58:05.811312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1243/2343] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:05 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:06.488821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:06.489734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:06.496023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.496471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.497251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.497685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.626259 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:06.635337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-85fff91b-4394-43c3-ab56-75cff06d2d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150364 Jul 21 22:58:06.635900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1101/2344] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:06.828466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:06.829147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:06.835919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.836369 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.837181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:06.837615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:06.840218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:06.964686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:06.972533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4311e235-2bbf-456c-b148-1ef246a591cb tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148002 Jul 21 22:58:06.973100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1244/2345] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:07.652555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:07.653063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:07.659641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.660082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:07.661605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.662195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:07.793717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:07.801744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f9531d76-4837-469f-9104-a3c520409861 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153051 Jul 21 22:58:07.802500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1102/2346] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:07.990187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:07.990759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:07.997326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.997778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:07.998535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:07.998976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.127969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.136915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-05dd2ad4-36c6-4a2d-8fa4-fbefd865f150 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150613 Jul 21 22:58:08.137509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1245/2347] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:08.819616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:08.820270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:08.827001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.827455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.828216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:08.828688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:08.957072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:08.964892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15144c0a-1160-4ae6-af66-af900fc30b37 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149900 Jul 21 22:58:08.965460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1103/2348] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:09.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:09.155034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:09.162522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.162971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.163728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.164173 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.293483 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:09.302040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e224aceb-8b79-46b1-b52e-d248113e468a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150982 Jul 21 22:58:09.302798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1246/2349] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:09.981701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:09.982325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:09.989878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.990456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:09.991229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:09.991670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.119842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.127841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-deb62cd7-74d8-4ac4-b668-b4fcdc466ae5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150002 Jul 21 22:58:10.128407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1104/2350] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:10.319190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:10.319823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:10.326206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:10.326658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.327666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:10.328097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:10.458948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:10.466952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b675bcb2-8e36-40d4-8624-75abfc738223 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151679 Jul 21 22:58:10.467517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1247/2351] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:10 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:11.145578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:11.146223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:11.152665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.153115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.153863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.154297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.287257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:11.295177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-97f92783-010c-4fdd-abe2-9214fbaa44f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153965 Jul 21 22:58:11.295739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1105/2352] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:11.485379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:11.486006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:11.492843 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.493423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.494445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:11.494885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:11.625000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:11.634016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-658774f7-e377-494d-88ce-7e69ef7a8e9b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152426 Jul 21 22:58:11.634515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1248/2353] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:11 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:12.312612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:12.313233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:12.320378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.320866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.321632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.322072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.450883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.459378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4faa0cb4-1d88-4256-99b8-9f916399674c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150686 Jul 21 22:58:12.459932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1106/2354] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:12.652087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:12.652702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:12.658816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.659260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.660007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:12.660436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:12.786094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:12.793979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5461237b-d857-4359-86d9-115d0f06cadc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146101 Jul 21 22:58:12.794541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1249/2355] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:12 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:13.476253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.476894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.483345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.483794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.484581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.485016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.616418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.624306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1b4604f5-c951-44ca-900e-5602985c6428 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151932 Jul 21 22:58:13.624898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1107/2356] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:13.811249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:13.811862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:13.819038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.819486 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.820232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:13.820755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:13.949782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:13.958373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-368df888-5e99-4d12-9bd4-7bd07907ab2c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150579 Jul 21 22:58:13.958932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1250/2357] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:13 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:14.642249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:14.642887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:14.649390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.649840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.650602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:14.651038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:14.779953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:14.788649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-297f48d2-9575-4732-91cc-82ec91b6ba73 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150237 Jul 21 22:58:14.789221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1108/2358] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:15.110365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:15.111000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:15.117389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.117835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.118584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.119013 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.250441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.258522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-82b0fb22-495e-4481-b25e-05a8d55ea841 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.287004 Jul 21 22:58:15.259076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1251/2359] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:15.805921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:15.806686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:15.813383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.813832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.814594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:15.815032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:15.819530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:15.944033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:15.951969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bbac288e-aa3a-4c32-b0fb-3de1a5b651c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149836 Jul 21 22:58:15.952471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1109/2360] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:16.276467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:16.277061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:16.283482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.283930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.284752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.285193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.416518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:16.424503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d58c57a9-1c72-47d8-9087-3911334963fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151940 Jul 21 22:58:16.425071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1252/2361] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:16.968659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:16.969292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:16.976220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.976696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:16.977448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:16.977877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.105883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.113987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cb84df97-487f-4374-94b3-b307b9f6d11a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149048 Jul 21 22:58:17.114548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1110/2362] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:17.441059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:17.442232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:17.444608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:17.449982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.450429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.451194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:17.451630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:17.584293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:17.592164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce257977-6789-4001-a683-ba04e7dfba68 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154934 Jul 21 22:58:17.592765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1253/2363] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:17 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:18.130909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:18.131513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:18.138043 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.138488 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.139278 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.139920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.271657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.279810 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86cca01d-611c-4eb8-87b3-69496031ad2a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153636 Jul 21 22:58:18.280602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1111/2364] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:18.609489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:18.610094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:18.616838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.617279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.618025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:18.618451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:18.745607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:18.753469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-892c003f-d491-493f-ac95-c9161dc18046 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147864 Jul 21 22:58:18.754027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1254/2365] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:18 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:19.297450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.298062 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.305078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.305530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.306282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.306715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.437074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:19.445886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5034e28e-864f-424d-b13c-d758dca4c5ee tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152339 Jul 21 22:58:19.446458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1112/2366] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:19.771482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:19.772005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:19.778524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.778971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.779712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:19.780140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:19.908673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:19.917103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f097892-481e-4aed-a0a7-87e5aa049fbd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150141 Jul 21 22:58:19.917657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1255/2367] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:19 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:20.463279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:20.463897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:20.470476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.470916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.471668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.472103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.601139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:20.608939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7bb6a612-955a-4be6-9c68-efaaf17f4ccd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149532 Jul 21 22:58:20.609499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1113/2368] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:20.933863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:20.934476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:20.940966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.941413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:20.942663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:20.943098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.071388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.079342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cadf1c82-5ab8-4581-8d67-b0bfb3a2da09 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149291 Jul 21 22:58:21.079903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1256/2369] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:21.626046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:21.626648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:21.633179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.633625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.634369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:21.634799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:21.764033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:21.772610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-be2ec1e4-b77b-4220-82a3-81311516eb92 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150335 Jul 21 22:58:21.773176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1114/2370] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:22.096632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.097245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.104222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.104709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.105470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.105905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.236322 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.244953 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70106398-5233-4898-8d3f-4097beb92d0b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152229 Jul 21 22:58:22.245518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1257/2371] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:22.789569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:22.790185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:22.796688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.797141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.797908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:22.798350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:22.927424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:22.935343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4f9a3212-b90c-4316-93e5-bedaf98d9dc7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149844 Jul 21 22:58:22.935910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1115/2372] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:23.262213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:23.262759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:23.269169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.269679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.270643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.271076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.399139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:23.407128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7f8a0a88-b5bf-46d7-8f05-b86868f14078 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148846 Jul 21 22:58:23.407684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1258/2373] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:23.952797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:23.953410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:23.955699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:23.961211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.961664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:23.962433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:23.962874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.092151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:24.100105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b5364f91-5bb3-4546-b875-ccda632a453d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151197 Jul 21 22:58:24.100694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1116/2374] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:24.424495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:24.425129 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:24.431593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:24.432035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.432822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:24.433252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:24.561993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:24.570767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fb79d3e6-b88f-49b0-a316-e34bfab7c9df tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150101 Jul 21 22:58:24.571333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1259/2375] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:24 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:25.116822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:25.117490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:25.124583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.125031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.125785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.126215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.256150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.263976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-621ee414-039d-43d6-aa4a-c126c93651c8 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151002 Jul 21 22:58:25.264556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1117/2376] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:25.588192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:25.588837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:25.595358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.595808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.596594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:25.597033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:25.728350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:25.730567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:25.737555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c303bac1-555c-4085-8f9f-58569a9eff4a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153251 Jul 21 22:58:25.738124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1260/2377] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:25 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:26.282058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.282711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.289405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.289862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.290630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.291071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.420327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.429779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-27f8a2e0-1373-4108-9096-53bb99d0e4ec tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151596 Jul 21 22:58:26.430348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1118/2378] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:26.755141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:26.756069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:26.762646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.763097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.763857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:26.764295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:26.890894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:26.898770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8ccdf558-f2b1-4c7b-ba0b-139a71668758 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147882 Jul 21 22:58:26.899345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1261/2379] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:26 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:27.446864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:27.447471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:27.453937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.454381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.455129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.455592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.584613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:27.592371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-466b2dca-8be8-4768-bbde-7d657b0c7f24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149386 Jul 21 22:58:27.592956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1119/2380] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:27.916597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:27.917209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:27.923623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.924071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:27.924859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:27.925297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.055580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:28.063514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b91cb051-42f2-4f3e-a6f2-2ae92abc22bc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150778 Jul 21 22:58:28.064086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1262/2381] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:27 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:28.609480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:28.610088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:28.616796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.617240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.617986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:28.618418 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:28.747514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:28.755931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-255131b1-5cdd-452c-929f-df3f0240e5ce tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150165 Jul 21 22:58:28.756520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1120/2382] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:29.080654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:29.081264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:29.088233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.088718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.089468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.089901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.222074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.230686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-29d44f3c-a177-4b13-a78a-17504877ecec tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153978 Jul 21 22:58:29.231253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1263/2383] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:29.773965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:29.774502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:29.780997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.781449 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.782207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:29.782643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:29.913290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:29.921137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d44e391-f7c3-49d5-9024-0f4e66caa6bc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152120 Jul 21 22:58:29.921697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1121/2384] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:30.247209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:30.247819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:30.254987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.255687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.256445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.256902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.387350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:30.395983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-42036637-38d3-4a4c-9728-a81011175023 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152696 Jul 21 22:58:30.396566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1264/2385] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:30 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:30.938048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:30.938643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:30.945180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.945627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:30.946376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:30.946806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.074812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.082842 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-989bfe23-d666-4a7b-9883-8b645fa31354 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148609 Jul 21 22:58:31.083407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1122/2386] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:31.414143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:31.414747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:31.421455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.421899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.422653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:31.423080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:31.550012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:31.558434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c8196147-0be3-479b-a117-8a48b4c84b28 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148912 Jul 21 22:58:31.559003 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1265/2387] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:32.100064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:32.100705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:32.107205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.107655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.108412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.108872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.241220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.249044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a3d73482-4516-427c-9e41-e690e634b3b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153321 Jul 21 22:58:32.249615 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1123/2388] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:32.575918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:32.576553 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:32.583263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.583713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.584471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:32.584943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:32.711923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:32.719805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63cb92ee-4364-4f9c-a7ff-508ef857c707 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147952 Jul 21 22:58:32.720370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1266/2389] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:33.266936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.267542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.274966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.275412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.276168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.276696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.408193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.417249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1792dfb5-d7fd-4839-86a8-3eb58456f76a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154067 Jul 21 22:58:33.418028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1124/2390] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:33.564536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.565033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.571614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.572060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.572835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.573270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.597682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:58:33.673078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8120bbb3-af50-41c4-a05f-fa8a3bcaaf84 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 204 len: 0 microversion: 2.20 time: 0.112137 Jul 21 22:58:33.673744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1267/2391] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 22:58:33 2022] DELETE /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 22:58:33.683965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.684838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.690694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.691800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.692754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.693192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.739050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:33.739803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:33.746396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.746842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.747755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:33.748191 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:33.846938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.849357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:33.859085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.860631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.861830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-022cbe21-94e9-4ac4-abd6-8cb6820dce58 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1723 microversion: 2.20 time: 0.182897 Jul 21 22:58:33.862386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1125/2392] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:33.904975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:33.913608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b21f1036-b84c-4fc5-a31a-b93f507ebb73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.179975 Jul 21 22:58:33.914169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1268/2393] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:33 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:34.434386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:34.434994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:34.442396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.442841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.443597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.444029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.573870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:34.582173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-262eddd5-5e67-4243-8341-eea514b9bb4a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151392 Jul 21 22:58:34.582798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1126/2394] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:34.880882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:34.881495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:34.887943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.888393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.889183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.889621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.931031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:34.931652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:34.937646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.938100 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:34.938868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:34.939308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.018242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.027235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.028766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.029924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5fd78349-562d-4e3a-a08d-f2a981df1bdb tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1723 microversion: 2.20 time: 0.153298 Jul 21 22:58:35.030482 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1269/2395] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:34 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:35.069438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.077315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-efa62bab-7adc-43bd-8c2d-42387dfee507 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150081 Jul 21 22:58:35.077880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1127/2396] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:34 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:35.600701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:35.601321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:35.607657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:35.608109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.608919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:35.609360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:35.749135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:35.757704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-68cc9357-3467-44a3-98cf-ffea6b263caa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.162062 Jul 21 22:58:35.758290 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1270/2397] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:36.048063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:36.048707 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:36.055365 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.055846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.056648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.057091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.094313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:36.094928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:36.102090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.102542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.103311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.103753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.241307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.249751 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.249921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a24cf6a6-10e9-4062-918f-9fe36edf8ecf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.159186 Jul 21 22:58:36.250579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1271/2398] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:36.259832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.261382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da46b59a0cb5430589aeef1693b2ce50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613f21f4b5164e6087e734f9b447e961', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.262596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9e056e7-d541-4c6e-8756-612278795697 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 200 len: 1723 microversion: 2.20 time: 0.218462 Jul 21 22:58:36.263166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1128/2399] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:36 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:58:36.565868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-e60c05c1-bedd-47dc-9de8-58788b33392d req-452a7fa8-9aba-4084-81ac-8e45197ad9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb189ff-56e0-4d7d-b194-05f2ac1d6e66", "name": "network-vif-deleted", "tag": "d3e6c79b-ab56-4bd3-8796-f4941fd75f1a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:58:36.575594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-e60c05c1-bedd-47dc-9de8-58788b33392d req-452a7fa8-9aba-4084-81ac-8e45197ad9c1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.575594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-e60c05c1-bedd-47dc-9de8-58788b33392d req-452a7fa8-9aba-4084-81ac-8e45197ad9c1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.589738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-e60c05c1-bedd-47dc-9de8-58788b33392d req-452a7fa8-9aba-4084-81ac-8e45197ad9c1 service nova] Creating event network-vif-deleted:d3e6c79b-ab56-4bd3-8796-f4941fd75f1a for instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 on hv-cinder-85069 Jul 21 22:58:36.598227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-e60c05c1-bedd-47dc-9de8-58788b33392d req-452a7fa8-9aba-4084-81ac-8e45197ad9c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035771 Jul 21 22:58:36.599382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1272/2400] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 22:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:58:36.774207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:36.774850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:36.781158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.781621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.782396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:36.782841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:36.917773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:36.925979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-40c37301-dcb7-4b0f-a7d7-56917ded9d70 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155713 Jul 21 22:58:36.926555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1129/2401] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:37.268343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.270931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.278474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.279373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.280157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.280629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.282311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.282906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.291454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.291915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.292735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.293196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.308235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] HTTP exception thrown: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Request method failure captured: Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 HTTP/1.1 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRTifTu9iFy6THmNw-yH4tX1513l4ml11M3TV4_vSPDJ7iN00GoqaconjYTAHgwnIJFnXr9H1jntu0qwuZLh8bQJbuuZ78IwAkZ9crt2q-Imi90zOVt8JeTG-UyLOKOvz8arXq3IsqRFW0m5vRbCaiLiQb1T55OGEtvgWdps0fghzM Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:58:37.310109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613f21f4b5164e6087e734f9b447e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: da46b59a0cb5430589aeef1693b2ce50 Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:37.311724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'fcb189ff-56e0-4d7d-b194-05f2ac1d6e66'} Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:37.313217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:37.314635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:37.317122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Returning 404 to user: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:37.317122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5d5de916-5e7f-4fc8-8ee8-966210a5f218 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 404 len: 111 microversion: 2.20 time: 0.033740 Jul 21 22:58:37.317122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1130/2402] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:58:37.320889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00f04072-2dea-43f5-9854-80f2287fdae8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '.version_select at 0x7ff1d8c8f8b0>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.324111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR oslo.messaging._drivers.impl_rabbit [None req-00f04072-2dea-43f5-9854-80f2287fdae8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [72af8a26-93b8-4f91-97ba-7ced9f5e5b60] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:58:37.417071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:37.427073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a0518ed8-980b-4bb1-9113-077bc8e86628 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.163248 Jul 21 22:58:37.428225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1273/2403] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:37.943039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:37.943644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:37.949568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.950011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:37.950754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:37.951177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.082011 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:38.090080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eb0dee86-fc72-47f4-b509-08f488462c05 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151086 Jul 21 22:58:38.090649 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1274/2404] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:58:38.332551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [None req-00f04072-2dea-43f5-9854-80f2287fdae8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [72af8a26-93b8-4f91-97ba-7ced9f5e5b60] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 57706. Jul 21 22:58:38.350935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00f04072-2dea-43f5-9854-80f2287fdae8 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014705132" status: 204 len: 0 microversion: 2.20 time: 1.033648 Jul 21 22:58:38.351511 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1131/2405] 10.222.0.42 () {60 vars in 1261 bytes} [Thu Jul 21 22:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014705132 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 22:58:38.444703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.445325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:38.451959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.452414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.453210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.453645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.601076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:38.608937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f8878b9c-eb10-4dd8-bd53-df0f87d008dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.168440 Jul 21 22:58:38.609824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1275/2406] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:38.962695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.963193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:38.970011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.970458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.971207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:38.971638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:38.984902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] HTTP exception thrown: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Request method failure captured: Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 HTTP/1.1 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRTifTu9iFy6THmNw-yH4tX1513l4ml11M3TV4_vSPDJ7iN00GoqaconjYTAHgwnIJFnXr9H1jntu0qwuZLh8bQJbuuZ78IwAkZ9crt2q-Imi90zOVt8JeTG-UyLOKOvz8arXq3IsqRFW0m5vRbCaiLiQb1T55OGEtvgWdps0fghzM Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 22:58:38.986429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613f21f4b5164e6087e734f9b447e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: da46b59a0cb5430589aeef1693b2ce50 Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:38.988369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'fcb189ff-56e0-4d7d-b194-05f2ac1d6e66'} Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:38.989399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:38.990884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 22:58:38.992471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Returning 404 to user: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:38.992471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4a5f3afc-5f11-4336-8214-290637355062 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 404 len: 111 microversion: 2.20 time: 0.029215 Jul 21 22:58:38.992471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1132/2407] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 22:58:38 2022] DELETE /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:58:38.996378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:38.997018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: fcb189ff-56e0-4d7d-b194-05f2ac1d6e66] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:39.002871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.003367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.004128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.004589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.017901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] HTTP exception thrown: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Request method failure captured: Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 HTTP/1.1 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRTifTu9iFy6THmNw-yH4tX1513l4ml11M3TV4_vSPDJ7iN00GoqaconjYTAHgwnIJFnXr9H1jntu0qwuZLh8bQJbuuZ78IwAkZ9crt2q-Imi90zOVt8JeTG-UyLOKOvz8arXq3IsqRFW0m5vRbCaiLiQb1T55OGEtvgWdps0fghzM Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 22:58:39.020052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613f21f4b5164e6087e734f9b447e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: da46b59a0cb5430589aeef1693b2ce50 Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:39.021830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'fcb189ff-56e0-4d7d-b194-05f2ac1d6e66'} Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:58:39.022824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. Jul 21 22:58:39.024362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 22:58:39.025907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Returning 404 to user: Instance fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:58:39.025907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-72ce9167-cc7e-471e-8130-73f0a5652e52 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66" status: 404 len: 111 microversion: 2.20 time: 0.028958 Jul 21 22:58:39.025907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1276/2408] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 22:58:38 2022] GET /compute/v2.1/servers/fcb189ff-56e0-4d7d-b194-05f2ac1d6e66 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:58:39.106867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:39.107407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:39.113571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.114013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.114768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.115199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.249665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:39.258444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-30cedc7a-7f49-489d-b87e-9e34a6e6e5b3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155532 Jul 21 22:58:39.259002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1133/2409] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:39.626791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:39.627408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:39.634791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.635246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.636004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:39.636443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:39.639087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:39.767367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:39.775498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-54e35943-0e9e-4311-8e61-a8744a3105da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152565 Jul 21 22:58:39.776055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1277/2410] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:40.275794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:40.276400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:40.282856 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.283302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.284052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.285170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.412193 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:40.420190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-51d11c10-724c-452d-9bda-437c5363c091 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148243 Jul 21 22:58:40.420780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1134/2411] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:40.792888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:40.793523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:40.800251 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.800725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.801525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:40.801952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:40.935097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:40.943449 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7f344ac8-2a32-484a-a781-6350f920e4c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154815 Jul 21 22:58:40.944005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1278/2412] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:40 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:41.436703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:41.437348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:41.448436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.448916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.449691 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.450127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.584657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:41.592499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a6e26257-8f35-4417-a2fd-ca1544da470d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.159727 Jul 21 22:58:41.593064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1135/2413] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:41.961042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:41.961655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:41.967631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.968080 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:41.968860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:41.969293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.098622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:42.106545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2eed6400-a8a7-4d8d-8ee8-aec549f673b0 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149990 Jul 21 22:58:42.107104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1279/2414] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:41 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:42.609516 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:42.610136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:42.617367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.617825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.618595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:42.619036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:42.750453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:42.759504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d6cecfb9-514a-42c6-9db9-98619d9efdc6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153881 Jul 21 22:58:42.760081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1136/2415] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:43.123085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:43.123698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:43.130872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.131316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.132067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.132515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.266669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:43.275421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-87b0fa7a-85e5-4a65-a07d-20d2ec0cbe80 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156172 Jul 21 22:58:43.275980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1280/2416] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:43.776926 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:43.777551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:43.783915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.784909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.785670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:43.786107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:43.914924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:43.922858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-91cf76d7-d2e9-48f3-a2d8-3103563d60a9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149981 Jul 21 22:58:43.923422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1137/2417] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:44.292310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:44.292984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:44.299460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.300495 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.301286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.301720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.430881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:44.438869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a523c074-ad08-4308-9f52-bd1a24e64d51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150379 Jul 21 22:58:44.439433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1281/2418] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:44 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:44.940433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:44.941367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:44.947718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.948170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:44.948951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:44.949392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.082210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:45.090065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b5d7eda0-f4bf-4d9d-a65b-8be699ce71d9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153512 Jul 21 22:58:45.090632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1138/2419] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:45.455847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:45.456575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:45.462957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.463403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.464154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:45.464614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:45.596433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:45.604991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ebe334d4-afa2-41c5-ad6f-6af5ef596466 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153016 Jul 21 22:58:45.605558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1282/2420] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:46.106970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:46.107607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:46.114732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.115182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.115934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.116368 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.245584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:46.254444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4d4124a8-8490-455b-bfc3-e0c9e990e4f7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151251 Jul 21 22:58:46.255031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1139/2421] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:46.622197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:46.622808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:46.630140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.630838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.631594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:46.632029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:46.759216 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:46.767057 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0d5d65d0-9b78-4be1-a024-691a27c9e9e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148745 Jul 21 22:58:46.767617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1283/2422] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:47.272231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:47.272846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:47.279543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.279990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.280776 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.281207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.412370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:47.420430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b038c8c1-efe2-4a3c-83f1-da49ae6a926b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152807 Jul 21 22:58:47.421031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1140/2423] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:47.784812 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:47.785452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:47.787859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:47.794186 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.794622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.795637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:47.796189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:47.930209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:47.938171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-07563cd9-d64f-48af-948a-e8dcf430ca0c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.157888 Jul 21 22:58:47.938733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1284/2424] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:47 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:48.437333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:48.437940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:48.445818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.446265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.447022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.447456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.579884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:48.587985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f2db2b26-c57b-4466-a8a6-7e3250385adf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154541 Jul 21 22:58:48.588564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1141/2425] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:48.955601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:48.956238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:48.962663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.963104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:48.963858 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:48.964285 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.091846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.100709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cc74d4de-11cc-4004-9299-6e8faa687614 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149220 Jul 21 22:58:49.101289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1285/2426] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:48 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:49.605250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:49.605897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:49.613783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.614300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.615064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:49.615499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:49.744588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:49.752576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c129a5ac-fe58-4f3d-8218-329ca393ed80 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151242 Jul 21 22:58:49.753664 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1142/2427] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.118808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.119420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.125826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.126271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.127022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.127455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.254374 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:50.262624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dc88d18d-9a50-4b52-8987-032e102d8b9a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147729 Jul 21 22:58:50.263181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1286/2428] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:50.770571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:50.771177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:50.777592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.778038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.778784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:50.779214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:50.910046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:50.917951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-180962dc-a600-448e-92eb-131f1ff32deb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151752 Jul 21 22:58:50.918507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1143/2429] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:51.279676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:51.280221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:51.287276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.287724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.288493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.288939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.422785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:51.431755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2665430f-7af0-405d-99cc-30dd4add0215 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156016 Jul 21 22:58:51.432546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1287/2430] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:51 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:51.934579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:51.935195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:51.942246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.942695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:51.943456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:51.943890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.070894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:52.073081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:52.080000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9aff3a1b-5666-4364-b382-bbaf768f964d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149467 Jul 21 22:58:52.080581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1144/2431] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:52.448103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:52.448823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:52.455171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.455613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.457225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:52.457655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:52.583143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:52.591107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-77f69d84-ffe9-477a-95a5-7a59551ff98e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146975 Jul 21 22:58:52.591669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1288/2432] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:53.097919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:53.098528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:53.105141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.105587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.106375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.106807 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.239591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:53.247634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de2ca7ce-2761-4f0f-8412-a9e53d98ed2f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154141 Jul 21 22:58:53.248197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1145/2433] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:53.608811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:53.609428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:53.615910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.616359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.617142 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:53.617574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:53.746926 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:53.754790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c0921f28-3e45-471f-9411-cd8f16a9bf13 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149896 Jul 21 22:58:53.755611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1289/2434] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:53 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:54.264802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.265415 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.267739 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:54.273426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.273878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.274638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.275084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.405836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.414715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9c0107e7-9748-48f4-a864-8a13c5de4780 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153569 Jul 21 22:58:54.415601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1146/2435] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:54.771759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:54.772361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:54.778766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.779211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.779959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:54.780391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:54.906376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:54.914700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-63ba0895-b905-4768-84df-e7e23ec179ed tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147479 Jul 21 22:58:54.915282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1290/2436] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:54 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:55.432952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:55.433597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.440194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.440684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.441454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.441891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.569575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:55.577461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4434a7d9-4c80-443b-adbd-f7d0a79fc28f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148352 Jul 21 22:58:55.578024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1147/2437] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:55.931602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:55.932205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:55.938606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.939049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:55.939795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:55.940221 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.068436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:56.076268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-91942dec-1280-4068-bf9a-a34e0d44d67f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148522 Jul 21 22:58:56.076862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1291/2438] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:56.594708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:56.595314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:56.601998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.602445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.603255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:56.603687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:56.732816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:56.741429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-65b54f89-856e-4d14-ba53-0ceb890c09dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150503 Jul 21 22:58:56.741990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1148/2439] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:57.093927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.094530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.101465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.101932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.102819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.103247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.229540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:57.237436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70bd5358-0c6a-4c24-a113-2e09d7fc7bad tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147320 Jul 21 22:58:57.237997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1292/2440] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:57.758238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:57.758767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:57.765304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.765746 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.766494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:57.766920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:57.897699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:57.905578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7986e7c7-3a44-46c9-846b-eb6ba0759084 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152073 Jul 21 22:58:57.906130 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1149/2441] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:58.253757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:58.254378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:58.262167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.262623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:58.263390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.263859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:58.398481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:58.400744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:58:58.408617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b999a58a-3167-43be-808d-dd369f4b29b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.158572 Jul 21 22:58:58.409220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1293/2442] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:58.921627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:58.922238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:58.929187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.929639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:58.930398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:58.930853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.062905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:59.071766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7688db28-0075-46cf-b6c0-3a75a2d1e3a5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154033 Jul 21 22:58:59.072337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1150/2443] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:58:59.427101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:58:59.427700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:58:59.434181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:59.434619 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.435370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:58:59.435799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:58:59.566922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:58:59.575470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-04f20e8c-9f92-4d40-97fe-663c93f18b53 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152779 Jul 21 22:58:59.576032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1294/2444] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:58:59 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:00.088845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:00.089455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:00.095989 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.096437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.097222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.097655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.229361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:00.237333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86c5a188-0489-4bf4-bb2c-b5ef7cbcb135 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152286 Jul 21 22:59:00.237838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1151/2445] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:00.592756 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:00.593361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:00.600312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.600786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.601535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:00.601964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:00.732342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:00.740162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b4625c4e-d486-4ac8-95dd-73c29eb513a4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151318 Jul 21 22:59:00.740751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1295/2446] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:01.254385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:01.255012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:01.261984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.262427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.263186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.263620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.392867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:01.401022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3a1c9c13-d3ff-490d-8530-2c9ec5906910 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150500 Jul 21 22:59:01.401578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1152/2447] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:01.757506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:01.758116 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:01.764655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.765101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.765854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:01.766282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:01.898211 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:01.906253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e1289121-785d-4e29-a708-e158fc2ff163 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153034 Jul 21 22:59:01.906814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1296/2448] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:02.418790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:02.419469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:02.426073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.427051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.427854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.428300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.557375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:02.565186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-130da30a-6c60-41f4-85ed-03900f405dc4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150723 Jul 21 22:59:02.565744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1153/2449] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:02.924470 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:02.925106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:02.932161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.932644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:02.933400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:02.933836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.061762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:03.069805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-693673d3-4c77-4961-9225-9d4973bbd64c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149196 Jul 21 22:59:03.070376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1297/2450] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:02 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:03.264436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:59:03.264695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:59:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:59:03.583356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:03.584359 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:03.590610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.591055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.591809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:03.592241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:03.802741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:03.810777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5ecfbb9a-0f24-499d-8885-49646a97b27d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.231926 Jul 21 22:59:03.811334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1154/2451] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:04.086813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:04.087354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:04.093958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.094410 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.095185 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.095622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.223703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:04.231833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0e326f18-c033-49ea-82e3-19dc9433c9b4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148969 Jul 21 22:59:04.232403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1298/2452] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:04.828166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:04.828821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:04.835957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.836409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.837194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:04.837628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:04.966370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:04.974953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6230cd26-968d-4be5-b701-7d561edcc7d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150646 Jul 21 22:59:04.975506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1155/2453] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:05.253337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:05.253857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:05.261275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:05.261721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:05.262472 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:05.262900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:05.392378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:05.400501 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e77e3c59-b6b6-49d1-9747-4f2973544168 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154828 Jul 21 22:59:05.401065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1299/2454] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:05 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:05.992014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:05.992658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:05.999728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.000209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.000998 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.001430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.127257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:06.135363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-39b7f07f-abed-4417-9f13-adcc654488d5 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147289 Jul 21 22:59:06.135921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1156/2455] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:06.418075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:06.418687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:06.426915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.427394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.428189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:06.428715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:06.572853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:06.581302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5ee8ca8b-4ddb-4407-99f1-7d4bf49e722b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.167576 Jul 21 22:59:06.581888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1300/2456] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:07.153266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:07.153892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:07.160741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.161408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.162177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.162610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.303048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:07.311066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ee761b52-48eb-48f4-b38a-921f036e958f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.162183 Jul 21 22:59:07.311639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1157/2457] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:07.598782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:07.599390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:07.605979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.606430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.607184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:07.607618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:07.736496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:07.745070 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ce32514-90e8-4237-b7c0-a793025ec751 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150209 Jul 21 22:59:07.745630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1301/2458] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:08.328396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:08.329038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:08.336090 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.336564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.337371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.337806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.467178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:08.475215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-115f7048-4814-4520-a3b1-f9e6ec8c5c8a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150632 Jul 21 22:59:08.475812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1158/2459] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:08.763326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:08.763852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:08.770245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.770772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.771524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:08.771952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:08.899782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:08.908083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-00f9b2f5-e2a3-458d-b8a2-41228cefad55 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148729 Jul 21 22:59:08.908683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1302/2460] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:08 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:09.492218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:09.492855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:09.499297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.499744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:09.500517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.501066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:09.633354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:09.641170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-03757ab7-b042-41d6-9d3e-88a489427792 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153021 Jul 21 22:59:09.641726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1159/2461] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:09.927219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:09.927841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:09.934296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.934740 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:09.935496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:09.935930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.067541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:10.075576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8cff30bb-cd5e-4cd9-81ab-caa9b6975093 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153142 Jul 21 22:59:10.076151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1303/2462] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:10.658041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:10.658654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:10.665884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:10.666334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.667091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:10.667534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:10.794049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:10.802584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1c9129f5-446f-4a9f-bfc2-b3d4d7833d64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148354 Jul 21 22:59:10.803150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1160/2463] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:11.092496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:11.093156 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:11.099719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.100160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.100935 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.101366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.228317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:11.236258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-30d6737a-26f9-4e3b-9a3a-4432add88a3f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147572 Jul 21 22:59:11.236840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1304/2464] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:11 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:11.819269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:11.819886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:11.826439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.826865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.827652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:11.828086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:11.842828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:11.954940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:11.963051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2821fc8-8ee0-4fc2-9c93-b4ed1958d8ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147832 Jul 21 22:59:11.963616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1161/2465] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:12.253361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:12.253877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:12.260552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.261000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.261753 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.262183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.397484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:12.405419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-224ff06d-7cd2-497a-a38c-61e720884bd9 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155997 Jul 21 22:59:12.406020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1305/2466] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:12 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:12.979553 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:12.980158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:12.986616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.987066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:12.987817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:12.988265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.120127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:13.127991 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-05acdd73-9d16-4331-bb1a-e7eabaec7806 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152297 Jul 21 22:59:13.128567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1162/2467] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:13.423112 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:13.423719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:13.430622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:13.431068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.431825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:13.432255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:13.562174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:13.570366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c111aa78-13eb-456b-9741-b7e48dc96e06 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151180 Jul 21 22:59:13.570931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1306/2468] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:13 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:14.146504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:14.147103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:14.153582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.154030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.154788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.155221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.287738 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:14.295638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f522ac9c-4337-4ba0-9fcd-02cdc890ce24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153784 Jul 21 22:59:14.296201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1163/2469] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:14.587339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:14.587955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:14.594457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.594910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.595669 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:14.596104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:14.725242 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:14.733192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8144c65f-0718-43ec-86f7-3712e1f254f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149734 Jul 21 22:59:14.733762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1307/2470] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:15.312819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:15.313425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:15.320102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.320580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.321394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.321858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.452503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:15.460984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9319a9c-68e4-4d40-b581-e5980b7ebde9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152116 Jul 21 22:59:15.461539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1164/2471] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:15.750047 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:15.750725 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:15.758959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.759413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.760178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:15.760641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:15.901665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:15.911821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-baba18b5-b0ee-4955-89dc-c5e8d6dfad65 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.165614 Jul 21 22:59:15.912413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1308/2472] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:15 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:16.477369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:16.477981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:16.484443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.484923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:16.485681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.486119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:16.658589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:16.666920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7cfcf9a-58e3-4e0d-b942-0371b8c71930 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.193373 Jul 21 22:59:16.667490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1165/2473] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:16.930163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:16.930774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:16.937233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.937683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:16.938441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:16.938872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:17.112133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:17.120734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6da273b0-a8c5-45de-bb5c-91b5bac27410 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.195387 Jul 21 22:59:17.121299 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1309/2474] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:17.684458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:17.685036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:17.692081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:17.692556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:17.693315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:17.693753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:17.825533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:17.833460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a35613f9-832c-49a8-9388-e34a0a901f88 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152886 Jul 21 22:59:17.834036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1166/2475] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:18.138527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:18.139118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:18.141442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:18.147354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.147795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.148563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.148998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.164248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:18.276385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:18.284629 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d5990f56-6387-4f40-a025-758e6b34f40d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149927 Jul 21 22:59:18.285761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1310/2476] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:18 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:18.851769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:18.852387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:18.858871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.859323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.860082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:18.860547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:18.990583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:18.998454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b3d6c401-dd72-425b-a64f-0d3cfe26bb6d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151495 Jul 21 22:59:18.999015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1167/2477] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:19.301385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:19.301996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:19.309107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:19.310689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:19.310689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:19.310689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:19.449700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:19.458511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2097c7e5-dbe1-48c4-84e9-b58d6e61845b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.160971 Jul 21 22:59:19.459076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1311/2478] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:19 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:20.015570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:20.016205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:20.022878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:20.023321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.024071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:20.024520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.156536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:20.164391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3e4270b3-5a4d-4432-96a9-a92e62e6a39c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152699 Jul 21 22:59:20.164980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1168/2479] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:20.475304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:20.475936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:20.482419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:20.482862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.483611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:20.484043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:20.609872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:20.618909 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-732d093a-cc45-4844-986c-25ec8327d001 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147723 Jul 21 22:59:20.619471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1312/2480] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:21.181330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:21.181935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:21.188448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.188947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.189701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.190133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.320972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:21.329219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f9be674b-aebf-48bd-9a3f-dcf2d6100a10 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151716 Jul 21 22:59:21.329774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1169/2481] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:21 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:21.636453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:21.637089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:21.643652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.644099 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.644905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:21.646046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:21.775628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:21.783497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7d6058eb-cb74-493c-95be-0c1bdee2caa5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150954 Jul 21 22:59:21.784042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1313/2482] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:21 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:22.346384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:22.346996 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:22.354370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.354820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.355584 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.356020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.487750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:22.496452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-35c8d4ea-ceb0-4920-b5d7-15b7e980173d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153942 Jul 21 22:59:22.497044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1170/2483] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:22.799931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:22.800576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:22.807301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.807752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.808545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:22.808989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:22.937618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:22.946190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3bc1f726-cb3c-491e-a302-4bc6289e51a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150098 Jul 21 22:59:22.946749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1314/2484] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:23.513255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:23.513865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:23.520406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:23.520922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:23.521769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:23.522206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:23.650859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:23.658916 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f532fa8e-4b86-4377-ba5e-2962a4cd775e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149534 Jul 21 22:59:23.659483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1171/2485] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:23.778797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:59:23.779008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 22:59:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:59:23.962876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:23.963532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:23.969915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:23.970353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:23.971096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:23.971522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:24.251810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:24.260524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d3e36fde-c06f-4815-abb3-42d2dcd003f1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.301420 Jul 21 22:59:24.261083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1315/2486] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:24.675131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:24.675802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:24.678257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:24.683540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:24.683992 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:24.684779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:24.685222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:24.816082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:24.824882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-594dac20-8411-4835-81e8-abcf01b01aac tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153643 Jul 21 22:59:24.825444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1172/2487] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:25.277977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:25.278586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:25.285016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.285469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.286220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.287778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.418942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:25.427106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e29a270a-2149-404b-ab99-44974beca7a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152862 Jul 21 22:59:25.432523 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1316/2488] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:25 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:25.842387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:25.842999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:25.850241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.850688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.851447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:25.851937 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:25.980412 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:25.988391 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-48ddefee-9e84-4b6b-86df-d3a1d2750bad tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149849 Jul 21 22:59:25.989000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1173/2489] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:26.444800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:26.445420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:26.451816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.452264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.453062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:26.453503 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:26.580269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:26.589234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cbbbe6c0-92b6-4b31-a118-8757ad238f11 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148645 Jul 21 22:59:26.589796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1317/2490] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:26 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:27.006302 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:27.006914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:27.013347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.013792 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.014541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.014975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.148901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:27.156761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0af5cd24-bbba-4aa8-9099-7b191506e013 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154802 Jul 21 22:59:27.157315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1174/2491] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:27.607169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:27.607807 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:27.614370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.615408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.616167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:27.616635 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:27.745194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:27.753158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b333c57d-6051-4f5a-b2ad-b70a6a06e3a5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149885 Jul 21 22:59:27.753724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1318/2492] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:27 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:28.174332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:28.174948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:28.182051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.182506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.183276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.183726 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.313292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.321127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e7238731-8b94-4cca-a4cf-11c9d1a2e730 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150711 Jul 21 22:59:28.321683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1175/2493] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:28 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:28.771549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:28.772097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:28.778690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.779138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.779893 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:28.780328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:28.908587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:28.917094 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6446e61f-7ba2-4d51-873e-f043121156dc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150126 Jul 21 22:59:28.917652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1319/2494] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:28 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:29.338797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.339411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.345945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.346430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.347183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.347619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.482765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:29.491330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86bc7ccf-efed-4fb0-a882-07d580553938 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156409 Jul 21 22:59:29.491888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1176/2495] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:29.934194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:29.934817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:29.941293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.941749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:29.942518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:29.942958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.073848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.081770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-776adb99-5049-4708-8287-b622eba0c746 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151562 Jul 21 22:59:30.082329 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1320/2496] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:30.508423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:30.509080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:30.515547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:30.515993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.516768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:30.517200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:30.643618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:30.651724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a5067a4a-e970-4ad6-8e66-f323591083dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147405 Jul 21 22:59:30.652292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1177/2497] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:31.099739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:31.100334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:31.106752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.107201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.107958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.108397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.234346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.242840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-23e3245f-e7f1-40f1-9ef6-9dae217de1c1 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147545 Jul 21 22:59:31.243399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1321/2498] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:31.668590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:31.669207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:31.675785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.676175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.676995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:31.677433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:31.679902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:31.806577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:31.814513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-08aeb458-9eeb-43ea-9e58-0327ee761b42 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149816 Jul 21 22:59:31.815077 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1178/2499] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:32.260668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:32.261274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:32.267597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.268048 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.268824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.269253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.396031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.403923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bb2fa62e-6bd6-430a-b062-8cec675cab36 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147223 Jul 21 22:59:32.404502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1322/2500] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:32.831838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:32.832455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:32.839113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.839603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.840366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:32.840832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:32.968901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:32.977543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2fec175-4dbd-40fd-89ad-1dd785d76b5e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149550 Jul 21 22:59:32.978111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1179/2501] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:33.423378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:33.424364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:33.433762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.434651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.434979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:33.435418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:33.565980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:33.574403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37062827-cd62-4d1b-be35-70afdea5c155 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.156873 Jul 21 22:59:33.574962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1323/2502] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:33 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:33.995027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:33.995638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:34.002144 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.002591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.003361 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.003778 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.133227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:34.141223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8a333880-77d6-4922-baa5-173be6bfc40f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149976 Jul 21 22:59:34.141781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1180/2503] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:34.591815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:34.592427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:34.599784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.600233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.601025 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:34.601460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:34.729894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:34.737887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f83e28a-bcd2-4448-93f6-1dfc48d26356 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149920 Jul 21 22:59:34.738445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1324/2504] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:34 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:35.157409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:35.158002 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:35.164429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.164904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.165657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.166086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.294798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:35.302704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2b553bdc-568d-40d5-a1c5-1f763b5572ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149115 Jul 21 22:59:35.303260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1181/2505] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:35 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:35.755413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:35.755948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:35.762435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.762884 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.763646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:35.764083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:35.891060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:35.899109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c5565499-c6a4-468e-a8b7-255e8e79f1a8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147968 Jul 21 22:59:35.899677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1325/2506] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:35 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:35.915215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:59:35.915215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 22:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:59:36.319897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:36.320528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:36.326956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.327416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:36.328176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.328635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:36.459922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:36.467788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-51673ec7-e93d-4a80-9fba-b0ff987b3058 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152228 Jul 21 22:59:36.468344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1182/2507] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:36.915534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:36.916146 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:36.923049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.923493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:36.924247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:36.924708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:37.055021 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:37.062859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-baf73595-09a4-455e-8b02-7c66c754828e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151345 Jul 21 22:59:37.063413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1326/2508] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:37.484569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:37.485173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:37.492224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:37.492698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:37.493450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:37.493880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:37.623561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:37.631995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4af4a7c8-da0d-420e-a668-e691e134d16d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151289 Jul 21 22:59:37.632611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1183/2509] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:38.080562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:38.081176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:38.088259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.088743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.089516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.089956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.092454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:38.218398 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:38.226996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-497b1b76-14a8-48d8-aa17-5ed9e59232cf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150339 Jul 21 22:59:38.227710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1327/2510] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:38.648888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:38.649505 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:38.656009 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.656461 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.657251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:38.657690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:38.784811 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:38.793854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1fe0f418-a4a0-4185-aca9-9f73b4bdb44a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148886 Jul 21 22:59:38.794424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1184/2511] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:39.244303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:39.244950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:39.251417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.251868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:39.252674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.253111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:39.380724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:39.388637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8601a79a-426a-4fc1-af84-efad1ffc0d18 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148098 Jul 21 22:59:39.389201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1328/2512] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:39.811084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:39.811696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:39.818885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.819342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:39.820137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:39.820605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:39.948440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:39.956374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2a75c89-ce74-42d9-80b1-2304834e9a65 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149184 Jul 21 22:59:39.956963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1185/2513] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:40.406344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:40.406962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:40.413862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:40.414317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:40.415081 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:40.415518 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:40.541912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:40.549980 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9539b4d3-f555-4347-8229-840fdb7965a6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147584 Jul 21 22:59:40.550562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1329/2514] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:40 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:40.973663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:40.974779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:40.980835 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:40.981283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:40.982031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:40.982463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:41.113971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:41.122073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f9c7a617-165a-4ce3-ac89-f12425ff0332 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152744 Jul 21 22:59:41.122671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1186/2515] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:41.567760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:41.568520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:41.574991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:41.575440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:41.576202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:41.576679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:41.705447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:41.713995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b8e91999-13f8-4920-b5fe-02788ab43568 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150781 Jul 21 22:59:41.714574 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1330/2516] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:41 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:42.139156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:42.139761 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:42.147255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.147698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.148450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.148915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.273938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:42.281971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f736d1f7-23b6-4a16-8bc6-3792a9e47d41 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146673 Jul 21 22:59:42.282552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1187/2517] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:42 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:42.731637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:42.732180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:42.738265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.739347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.740110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:42.740560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:42.869016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:42.876830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-caea872e-b35b-4a6c-b993-0bb0bc217064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149095 Jul 21 22:59:42.877385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1331/2518] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:42 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:43.299319 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:43.299930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:43.306467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.306920 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:43.307676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.308114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:43.442929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:43.450815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8d51f694-ff01-4cf2-a3d4-c74560ba7fb1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155324 Jul 21 22:59:43.451387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1188/2519] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:43.894201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:43.894999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:43.901492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.901943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:43.902689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:43.903118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:44.036705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:44.044701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a059a1d1-e85e-4cbb-9551-07ef16f450ea tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154246 Jul 21 22:59:44.045257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1332/2520] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:44.468501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:44.469135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:44.476336 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:44.476834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:44.477594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:44.478033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:44.604306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:44.612142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a98921c0-fc6d-4996-8d18-08ce09787419 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147523 Jul 21 22:59:44.612728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1189/2521] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:45.061758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:45.062403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:45.068907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.069354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.070103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.070534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.202255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:45.210779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94ce908a-17ad-4853-bbb5-e1d39245b3da tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152862 Jul 21 22:59:45.211337 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1333/2522] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:45.628983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:45.630428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:45.636936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.637390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.638152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:45.638592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:45.766772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:45.775604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-df18b37e-cc15-46a5-aa2c-650d9a9c102b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150440 Jul 21 22:59:45.776185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1190/2523] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:46.228692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:46.229333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:46.235901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.236343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.237132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.237563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.364596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:46.372434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fa45fe6c-2766-43e8-8143-e63ed9dd3a83 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147794 Jul 21 22:59:46.373009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1334/2524] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:46.792577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:46.793167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:46.799581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.800026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.800808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:46.801290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:46.927255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:46.935091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fcdb09b2-5f3d-4213-bf6c-f971a699df6c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146430 Jul 21 22:59:46.935651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1191/2525] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:59:47.389982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:47.390604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:47.397161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.397608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:47.398364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.398797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:47.528301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:47.536383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f0a447d-a9be-46dd-bdf3-b4ab8e1157a3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150283 Jul 21 22:59:47.536970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1335/2526] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:47 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:47.952159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:47.952794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:47.959376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.959820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:47.960593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:47.961027 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.086401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:48.094208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bc30d27b-aa66-4369-982e-be3303d149c4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.145900 Jul 21 22:59:48.094770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1192/2527] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:48.555233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:48.556178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:48.559540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:48.567950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.568654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.569826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:48.570528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:48.701630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:48.710358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d38447c2-a4bb-4acc-a31f-19b1fcbd32b5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.160745 Jul 21 22:59:48.710905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1336/2528] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:48 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:49.111964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:49.112612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:49.119649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.120105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.120897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.121338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.268714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:49.277078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3963fbb2-3aad-4948-9196-d0cab53aa2ea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.168970 Jul 21 22:59:49.277643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1193/2529] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:49 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:49.727989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:49.728631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:49.735046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.735491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.736244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:49.736706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:49.864520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:49.872407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d1b58859-aa78-42e2-b917-b748feed3839 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149117 Jul 21 22:59:49.872988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1337/2530] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:49 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:50.294473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:50.295084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:50.301813 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.302252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.303004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.303431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.431176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:50.433763 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:50.440627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3e025ea3-c758-4b76-9478-9a4e02c596f2 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150025 Jul 21 22:59:50.441212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1194/2531] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:50.889012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:50.889569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:50.896120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.896600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:50.897360 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:50.897794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:51.023560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:51.031438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ea616fd0-e7aa-44d7-8c71-3c7f3533af16 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146408 Jul 21 22:59:51.031994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1338/2532] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:51.458563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:51.459172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:51.467660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:51.468469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:51.469892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:51.470685 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:51.835003 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:51.842950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2f8ed945-5ace-4239-b4ea-7cb13cf79947 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.389455 Jul 21 22:59:51.843514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1195/2533] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:52.048910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:52.049522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:52.056230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.056722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:52.057496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.057937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:52.187668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:52.196152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3a003a20-638f-4778-a22e-45ac4681b0d5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151127 Jul 21 22:59:52.196739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1339/2534] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:52.860833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:52.861474 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:52.868871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.869316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:52.870059 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:52.870489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:52.998955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:53.007182 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c7e28ed4-284b-486a-820e-a0ae9b42530d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150140 Jul 21 22:59:53.007745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1196/2535] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:53.213245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:53.213767 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:53.220140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:53.220616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:53.221368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:53.221796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:53.349786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:53.357708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-33f21dba-33eb-4ef0-b611-4918719eea73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148422 Jul 21 22:59:53.358261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1340/2536] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:53 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:54.025484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:54.026075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:54.032571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.033023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.033782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.034216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.164332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:54.172204 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fa81c99c-fd33-4635-8053-32d17b630366 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151474 Jul 21 22:59:54.172789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1197/2537] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:54.374793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:54.375397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:54.382939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.383913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.384220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:54.384671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:54.511235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:54.519095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-226c43bc-cc68-4728-bd33-0e2c48d647bf tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148160 Jul 21 22:59:54.519680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1341/2538] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:54 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:55.189620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:55.190226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:55.193161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:55.198487 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.198931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.199681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.200110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.326151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:55.334849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1655647e-e07e-43a4-8a27-1b4db6dca363 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149028 Jul 21 22:59:55.335408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1198/2539] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:55.536571 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:55.537177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:55.543578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.544023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.544803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:55.545232 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:55.678119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:55.686032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-942ac53b-d617-4a15-aab6-15fe3373d82a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153353 Jul 21 22:59:55.686596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1342/2540] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:56.351592 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:56.352234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:56.358709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.359158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.359921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.360356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.487076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:56.495178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-65f7fe9f-7516-464d-82af-e638ff708edc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148087 Jul 21 22:59:56.495729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1199/2541] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:56 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:56.703104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:56.703630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:56.710797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.711239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.711988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:56.712417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:56.836845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:56.839010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:59:56.845982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-46a61bda-31f8-4006-b79f-c3fb3140373b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146767 Jul 21 22:59:56.846536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1343/2542] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:57.511725 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:57.512331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:57.518925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.519374 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:57.520123 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.520981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:57.651014 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:57.658831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-557fbfad-e72f-46a6-8d38-381aa891bd03 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150994 Jul 21 22:59:57.659392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1200/2543] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:57.863103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:57.863741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:57.870721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.871171 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:57.871918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:57.872350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:58.001167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:58.009388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f0ca113d-9fec-4588-83b0-3fe095006df7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150169 Jul 21 22:59:58.009945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1344/2544] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:58.676211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:58.677334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:58.683789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:58.684179 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:58.684945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:58.685376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:58.814241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:58.822730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b4b2bddc-7cb6-47f5-85e1-5934e18bcabd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150476 Jul 21 22:59:58.823296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1201/2545] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:59.025561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:59.026103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:59.032618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.033075 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.033842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.034279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.163269 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:59.171180 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-03056791-b608-45d4-a106-92a9b0eebd94 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149539 Jul 21 22:59:59.171739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1345/2546] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:59 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:59:59.839826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:59:59.840448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:59:59.846904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.847353 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.848115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:59:59.848768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:59:59.979642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:59:59.987571 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-18340a57-c1c3-4a30-9b1e-8d617a6ec6c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151712 Jul 21 22:59:59.988141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1202/2547] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 22:59:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:00.188969 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:00.189510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:00.197063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:00.197514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:00.198275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:00.198709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:00.325394 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:00.333301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-600d2c16-4ad7-4412-9fea-6dd0614548f3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148268 Jul 21 23:00:00.333842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1346/2548] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:01.005110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:01.005747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:01.012141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.012623 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.013377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.013806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.141434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.150013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3a35f80a-b6be-4dc3-9026-6e06f95266bd tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149223 Jul 21 23:00:01.150702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1203/2549] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:01.350256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:01.350868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:01.357408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.357886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.358643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:01.359078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:01.487632 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:01.496122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9ac0b70f-3214-4f5e-89d0-5fd9280bc6ac tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149801 Jul 21 23:00:01.496715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1347/2550] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:01 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:02.167251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:02.167860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:02.174272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.174714 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.175468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.175898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.306684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:02.314578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de649fb3-42f9-4a14-85c0-c9964ccd8bdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151216 Jul 21 23:00:02.315150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1204/2551] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:02.514335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:02.514942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:02.521800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.522241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.522990 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:02.523421 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:02.649564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:02.657605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b030151c-f6db-4032-8582-42df067b2463 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147107 Jul 21 23:00:02.658177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1348/2552] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:02 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:03.331131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:03.331750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:03.338560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.339016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.339787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.340228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.471596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.480106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3a66cac-72e6-4fb2-8618-6d94eb55aa20 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152845 Jul 21 23:00:03.480690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1205/2553] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:03 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:03.675425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:03.675928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:03.683733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.684194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.685012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:03.685456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:03.814340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:03.822434 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cfc897a6-f2ad-479e-8b11-007e6a3117b8 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151307 Jul 21 23:00:03.822995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1349/2554] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:04.497630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:04.498245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:04.505134 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.506063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.506829 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.507269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.636018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.643873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cd13e6fc-f52e-4ec7-a7ee-84baa6222f3e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150146 Jul 21 23:00:04.644441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1206/2555] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:04.840125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:04.840789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:04.847276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.847727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.848511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:04.848962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:04.979102 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:04.986974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4e06fc1d-eae1-4a7b-bce5-6eae86a1730d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150727 Jul 21 23:00:04.987528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1350/2556] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:05.661945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:05.663154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:05.669740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.670195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.670969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:05.671408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:05.868455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:05.876356 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-77e2cb31-c0d7-4253-b292-80545bf831d1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.218804 Jul 21 23:00:05.876953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1207/2557] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:06.004061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.005053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.011544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.011988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.012834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.013267 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.144987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:06.153846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-67699308-c24a-4977-80c4-ff79e2745f73 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153569 Jul 21 23:00:06.154690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1351/2558] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:05 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:06.893519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:06.894131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:06.900642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.901094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:06.901851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:06.902286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.033369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.041777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d718596-755c-4e7d-a3c0-62916566a0ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152084 Jul 21 23:00:07.042339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1208/2559] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:07.172176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:07.172743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:07.179703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.180149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.180933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:07.181367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:07.521001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:07.529292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6831ce6-1b46-4d5d-84bf-84ef7862fb81 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.360984 Jul 21 23:00:07.529856 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1352/2560] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:08.059652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:08.060205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:08.066332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.066910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.068321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.068731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.216291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:08.224181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e35220c6-8dcd-402c-89de-ed48865e1bd4 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.169093 Jul 21 23:00:08.224797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1209/2561] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:08.546868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:08.547499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:08.554597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.555041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.555793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:08.556222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:08.684113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:08.692016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-35689f1b-1db0-4b38-9eb3-9c566c2b7729 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149026 Jul 21 23:00:08.692603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1353/2562] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:08 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:09.241296 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:09.241910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:09.248411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.248902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.249661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.250098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.376354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.385040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-897192d0-59ac-4b17-921d-a59a07690a90 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147869 Jul 21 23:00:09.385600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1210/2563] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:09 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:09.709724 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:09.710343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:09.716751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.717199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.717956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:09.718388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:09.847516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:09.855515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7da7f310-733b-4eb1-b906-5b6d90a02d40 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150350 Jul 21 23:00:09.856090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1354/2564] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:10.401938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:10.402542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:10.409069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.409518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.410269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.410700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.425625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:10.543147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:10.550947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bcca484e-7445-4c82-b270-2743de40cbb3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152839 Jul 21 23:00:10.552229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1211/2565] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:10.872660 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:10.873266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:10.880462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.880930 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:10.881678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:10.882107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.006916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.014714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a06cf3d1-fd2b-4113-8174-90996948cc87 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145919 Jul 21 23:00:11.015284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1355/2566] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:10 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:11.569056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:11.569667 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:11.576028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.576499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.577258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:11.577690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:11.705537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:11.713934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d815e360-882e-4e0f-ae94-77c1b5f1a5c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149080 Jul 21 23:00:11.714513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1212/2567] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:12.031271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:12.031801 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.037933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.038383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.039135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.039568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.166685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:12.174592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ceb5e782-ac05-484a-9a90-fa65c51b8f98 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147340 Jul 21 23:00:12.175161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1356/2568] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:12 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:12.730837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:12.731360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:12.737869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.738326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.739693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:12.740249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:12.871053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:12.878930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4d338790-1859-48e9-a0fa-c6fac6cea6bb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152051 Jul 21 23:00:12.880238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1213/2569] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:13.192077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:13.192751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:13.199198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.199648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.200408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.200869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.326059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:13.335061 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bf32fdac-c171-4238-925a-51a6060d1956 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146837 Jul 21 23:00:13.335625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1357/2570] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:13 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:13.896915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:13.897534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:13.904093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.904611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:13.905377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:13.905818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.033145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:14.042451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fec270c8-0359-4da7-a8da-57f43f1c6005 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149416 Jul 21 23:00:14.043017 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1214/2571] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:14.352533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:14.353143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:14.359557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.360004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.360782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:14.361212 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:14.493473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:14.501359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9302687f-9c12-4640-a18b-99c6e94cb55c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153237 Jul 21 23:00:14.501911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1358/2572] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:15.060705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:15.061325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:15.068264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.068745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.069510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.069951 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.195512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.203417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8f541bf2-b5d8-4689-919e-6a37cdc34eb7 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146654 Jul 21 23:00:15.203982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1215/2573] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:15.518729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:15.519341 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:15.526422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.526876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.527634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:15.528072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:15.658507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:15.667271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-141b7c2c-a52a-4a63-be00-b767e9ab5836 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152471 Jul 21 23:00:15.667833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1359/2574] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:15 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:16.266093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:16.266702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:16.273578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.274024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.274773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.275206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.406838 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:16.414960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f1536614-7b53-4a1f-a77e-4b5f0be6bfdf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.198440 Jul 21 23:00:16.415528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1216/2575] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:16 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:16.685319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:16.685927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:16.693095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.693540 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.694291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:16.694720 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:16.709255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:16.820174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:16.827993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-38614a3b-2c4d-4079-9176-5b7a10c410ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146549 Jul 21 23:00:16.828569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1360/2576] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:16 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:17.432666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:17.433724 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:17.439758 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.440201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.440986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.441419 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.568242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.576187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3c74f0f1-faf2-4fe5-a562-3ad49b3193e6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147374 Jul 21 23:00:17.576782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1217/2577] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:17 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:17.845412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:17.846016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:17.852894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.853339 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.854089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:17.854545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:17.984998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:17.993452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1ff9b5f3-bd96-4183-9e6f-13576328c391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151948 Jul 21 23:00:17.994010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1361/2578] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:17 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:18.592930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:18.593546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:18.600470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.600957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.601721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:18.602159 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:18.734253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:18.742349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4eff1b2a-a805-41c4-a749-2829ba9d58f9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153281 Jul 21 23:00:18.742914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1218/2579] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:18 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:19.011354 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.011996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.014373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:19.019598 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.020054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.020876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.021311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.149254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.157127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-161e4568-63e4-4fc4-a7d8-6d6a749dadd7 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149736 Jul 21 23:00:19.157697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1362/2580] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:19.759530 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:19.760048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:19.766594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.767048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.767812 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:19.768251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:19.896922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:19.904772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ab65a03c-b69a-4fc7-a528-6c6c678d1c19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149240 Jul 21 23:00:19.905330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1219/2581] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:19 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:20.173975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.174587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.181570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.182026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.182790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.183230 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.320522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:20.328396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c583a528-7358-4dbe-9cbb-12022c0dff85 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.158339 Jul 21 23:00:20.328984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1363/2582] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:20.921977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:20.922582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:20.929806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.930254 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:20.931007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:20.931439 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.057528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.065376 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1caf084c-75a0-44c8-948b-df84d1b3450f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147271 Jul 21 23:00:21.065938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1220/2583] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:20 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:21.346284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:21.346897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:21.353390 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.353837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.354595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:21.355029 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:21.485491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:21.494119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cad2980b-3e21-4495-b77c-7d7ab0f4db93 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151691 Jul 21 23:00:21.494682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1364/2584] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:21 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:22.082756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.083849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.090052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.090496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.091250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.091682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.222618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:22.230965 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-909e55e8-93c8-45a7-8e1a-82124796a86a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152204 Jul 21 23:00:22.231527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1221/2585] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:22.511050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:22.511665 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:22.518051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.518505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.519275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:22.519715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:22.647108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:22.655153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c6fb00a-e450-4e53-be13-11cae0f9954a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148001 Jul 21 23:00:22.655722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1365/2586] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:22 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:23.248404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.248960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.255790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.256236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.257021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.257452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.386035 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.393990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b7b2d28f-d5bf-43ba-af1d-8cf6d701cd93 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149512 Jul 21 23:00:23.394550 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1222/2587] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:23.673465 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:23.674077 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:23.680655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.681107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.681899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:23.682332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:23.809597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:23.817450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-981ec3f5-bba7-449e-b729-ff92c75ccf17 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147881 Jul 21 23:00:23.818514 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1366/2588] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:23 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:24.411241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.412342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.419565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.419565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.420325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.420797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.553463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.561313 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-debc1954-bc6e-4ea8-8b27-8f99dd098862 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153938 Jul 21 23:00:24.561881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1223/2589] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:24 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:24.835430 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:24.836035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:24.842456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.842899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.843677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:24.844108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:24.983187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:24.991491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4db19d32-3b30-4d4d-981c-6b0e9db9694b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.160499 Jul 21 23:00:24.992056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1367/2590] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:24 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:25.578088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:25.578704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:25.581028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:25.586836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.587285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.588044 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:25.588502 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:25.721750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:25.730308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8633674-39fc-4559-9679-7190b896afaa tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.156096 Jul 21 23:00:25.730873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1224/2591] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:25 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:26.008682 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.009217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.015860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.016309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.017093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.017530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.146513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:26.154336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cb229783-333c-433e-b6f8-d8ae56d45747 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149655 Jul 21 23:00:26.154895 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1368/2592] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:26.747112 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:26.747659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:26.754481 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.754936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.755962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:26.756404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:26.886039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:26.893892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-51eb8737-0468-49dd-8136-6b0fe9743dea tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150704 Jul 21 23:00:26.894447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1225/2593] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:26 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:27.171066 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:27.171684 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:27.178300 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.178757 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.179519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.179961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.306731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:27.314661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6089ecb3-15ef-474e-8a7d-aff28f064302 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147506 Jul 21 23:00:27.315225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1369/2594] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:27 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:27.910695 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:27.911909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:27.918330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.918781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:27.919536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:27.919972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.046217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.054173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b26c343d-fe9c-45e2-a6b7-d91554162018 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147357 Jul 21 23:00:28.054730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1226/2595] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:27 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:28.332241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:28.332871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:28.339988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.340427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.341201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:28.341628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:28.471628 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:28.479799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cf49b8da-ca54-41be-a826-287145a3d369 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151396 Jul 21 23:00:28.480367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1370/2596] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:28 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:29.071008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.071606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.078063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.078507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.079257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.079686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.210977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.218851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c1a31a1e-2446-42a7-bf93-432debd04e24 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151951 Jul 21 23:00:29.219411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1227/2597] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:29.496782 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:29.497400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:29.503799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.504516 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.505396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:29.505836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:29.636002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:29.643888 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9f1588c1-045a-47dd-9f31-ad3106b6484b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150986 Jul 21 23:00:29.644459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1371/2598] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:29 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:30.235094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:30.235706 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:30.242633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.243080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.243831 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.244264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.246753 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:30.374202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.383004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9664fa9d-9e13-4b0b-8992-98bf92802849 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151826 Jul 21 23:00:30.383563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1228/2599] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:30 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:30.661972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:30.662538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:30.668963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.669414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.670172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:30.670610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:30.799090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:30.807620 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ecb596f9-3a21-4d0e-87b7-1ea762de2a5f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150229 Jul 21 23:00:30.808183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1372/2600] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:30 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:31.400650 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:31.401265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:31.407717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.408168 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.408959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.409400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.535888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:31.543954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-60c64b0c-9ba3-43da-82ed-3ce154fd312c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147438 Jul 21 23:00:31.544532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1229/2601] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:31 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:31.824832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:31.825453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:31.832358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.832841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.834281 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:31.834721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:31.963484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:31.971345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a38b7593-52d3-47f4-97b7-d7f82f482d71 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150387 Jul 21 23:00:31.971905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1373/2602] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:31 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:32.561357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.561979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.569158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.569620 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.570382 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.570824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.702633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:32.710733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e0a48e12-22ca-4f36-baac-9ac84705435d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153361 Jul 21 23:00:32.711304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1230/2603] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:32.988939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:32.990352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:32.996827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.997273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:32.998018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:32.998450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.124827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:33.133192 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-989cb4eb-2e67-4236-9d61-faa97f413064 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148174 Jul 21 23:00:33.133747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1374/2604] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:32 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:33.727717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:33.728323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:33.734770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.735215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.735970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:33.736404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:33.864015 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:33.871888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0ccda523-75e4-424b-a310-6eb2bf5f5680 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148659 Jul 21 23:00:33.872450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1231/2605] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:33 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:34.150208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:34.150819 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:34.157489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.157936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.158687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.159118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.290642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:34.298542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-77042e0a-1104-4a45-b34c-722dd55226b6 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152170 Jul 21 23:00:34.299108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1375/2606] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:34 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:34.889192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:34.889830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:34.896967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.897410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:34.898157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:34.898587 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.026919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:35.034678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-55ff569b-1a1d-4983-b4b2-a7339bd0725b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149427 Jul 21 23:00:35.035228 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1232/2607] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:34 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:00:35.314948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:35.315596 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:35.322733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.323187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.323942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:35.324378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:35.453544 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:35.462184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-719b8e95-e257-48db-ba29-580a87b43de5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151215 Jul 21 23:00:35.462748 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1376/2608] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:35 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:36.052333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:36.053400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:36.059872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.060321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.061185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.061621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.193552 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:36.201473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2084f65-a4b9-4143-b73c-47d278480776 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153511 Jul 21 23:00:36.202033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1233/2609] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:36 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:36.479870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:36.480532 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:36.487305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.487786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.488581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:36.489690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:36.492266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:36.621357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:36.629432 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52574506-2200-4721-a289-89248da62560 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153457 Jul 21 23:00:36.630132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1377/2610] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:36 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:37.218410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:37.219029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:37.225641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.226093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.226858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.227324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.356687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:37.364540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d476052d-6bd0-4299-84b6-35f5bec6a1ed tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150018 Jul 21 23:00:37.365105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1234/2611] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:37 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:37.646549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:37.647181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:37.653676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.654131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.654910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:37.655331 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:37.793453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:37.802570 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f026d511-ae5a-44fe-967f-c6433d55dafd tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.159904 Jul 21 23:00:37.803141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1378/2612] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:37 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:38.381818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:38.382432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:38.388904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.389354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.390114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.390546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.524098 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:38.531899 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fb7aeca1-ebfc-47e3-ac94-976e4573ef5a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.154455 Jul 21 23:00:38.532450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1235/2613] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:38 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:38.820454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:38.821090 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:38.827507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.827955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.828742 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:38.829176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:38.954412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:38.963121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0bbdde69-a18b-48a8-bb86-51d1aff9d89b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147461 Jul 21 23:00:38.963689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1379/2614] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:38 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:39.549324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:39.549941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:39.557079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.557529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.558289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.558734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.685095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:39.693225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-15104979-c197-4eda-aa9c-712f83f906ff tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147828 Jul 21 23:00:39.693784 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1236/2615] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:39 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:39.980445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:39.981015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:39.987351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.987798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:39.988586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:39.989028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:40.119519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:40.127448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab3b5780-1129-4219-93ff-999d63331391 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150940 Jul 21 23:00:40.128019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1380/2616] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:39 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:40.715464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:40.715994 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:40.722525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:40.722978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:40.724331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:40.724790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:40.856545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:40.864379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd09e572-19e2-43af-88e6-2d6e7c336ec0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152969 Jul 21 23:00:40.864969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1237/2617] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:40 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:41.144606 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:41.146315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:41.152891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.153340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.154122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.154559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.280834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:41.288897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78af4adc-cf01-4f70-8b5c-6636ce78757d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148160 Jul 21 23:00:41.289462 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1381/2618] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:41 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:41.881541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:41.882152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:41.888673 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.889128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:41.889886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:41.890321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.015643 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:42.023479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7beec02-a000-4d6a-bbd2-442ef7e2d466 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146156 Jul 21 23:00:42.024032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1238/2619] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:41 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:42.306561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:42.307248 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:42.313225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.313668 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.314415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:42.314842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:42.446439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:42.454428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f9291dc6-5e7b-4f2c-81cd-637b6742fb1c tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151878 Jul 21 23:00:42.454983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1382/2620] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:42 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:43.040226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.040872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.047455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.047907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.048705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.049141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.178781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:43.187654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ca7f52c7-1b2a-4668-bd71-a7d54bfa1287 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151288 Jul 21 23:00:43.188564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1239/2621] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:43.471121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:43.471736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:43.479396 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.479845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.480638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:43.481073 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:43.608581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:43.616845 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a96c5cb7-29d3-4fbf-851c-f3ca02abe610 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149532 Jul 21 23:00:43.617345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1383/2622] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:43 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:44.205340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.205952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.213157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.213945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.214351 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.214794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.346494 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:44.354565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d578e09-d787-455f-ba92-51277245d30f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153075 Jul 21 23:00:44.355140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1240/2623] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:44 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:44.634704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:44.635298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:44.641717 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.642158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.642904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:44.643335 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:44.768395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:44.776273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-89687f66-359f-4807-a0d5-d98257dee6de tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.145452 Jul 21 23:00:44.776861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1384/2624] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:44 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:45.371830 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:45.372503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:45.379431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.379864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.380671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.381113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.509898 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:45.517850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fc657f31-acb9-46fa-89e7-0ac2a90fb340 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149860 Jul 21 23:00:45.518978 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1241/2625] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:45 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:45.793913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:45.794550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:45.801525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.801986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.802730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:45.803155 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:45.936957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:45.945955 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f536f2b0-0944-4b99-905d-f40af2b164ae tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.155878 Jul 21 23:00:45.946624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1385/2626] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:45 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:46.536985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:46.537639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:46.544052 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.544524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.545284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.545715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.677507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:46.685071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d35da371-b410-4d9d-a494-29354d1c9486 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152413 Jul 21 23:00:46.685575 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1242/2627] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:46 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:46.963693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:46.964243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:46.970744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.971188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:46.971937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:46.972366 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.100147 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:47.107988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-932e8791-dec2-4098-8b3f-7e9062ee5d45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148205 Jul 21 23:00:47.108564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1386/2628] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:46 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:47.701893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:47.702455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:47.709178 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.709631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.710396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:47.710837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:47.841274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:47.849851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d63f3b6e-b495-4630-b279-ffd288fac7d6 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151869 Jul 21 23:00:47.850422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1243/2629] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:47 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:48.124866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:48.125475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:48.132739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.133183 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.133928 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.134361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.263162 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:48.271082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bcefd9a1-a525-46d1-b8df-2b433f44bc35 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150085 Jul 21 23:00:48.271653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1387/2630] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:48 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:48.866246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:48.866872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:48.873350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.873804 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:48.874564 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:48.875001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.005955 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:49.008128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:49.014895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b26ed03d-9df6-4f4d-a70e-2de7979a3663 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153108 Jul 21 23:00:49.015465 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1244/2631] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:48 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:49.287913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:49.288541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:49.290865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=52 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:49.296370 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.296841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.297599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:49.298034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:49.427085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:49.435058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-51b6f404-8120-4b65-bea0-9a666736ba45 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151098 Jul 21 23:00:49.435618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1388/2632] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:49 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:50.033030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:50.033633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:50.040822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.041277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.042041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.042480 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.173586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:50.182514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b3481320-6a5c-41e0-aedd-ec2152fa9d99 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153401 Jul 21 23:00:50.183080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1245/2633] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:50 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:50.453253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:50.453867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:50.461046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.461496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.462249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:50.462685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:50.588597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:50.596463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1090b56b-caef-4e13-b0e9-b70658e09d5b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147095 Jul 21 23:00:50.597045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1389/2634] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:50 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:51.199863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:51.200421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:51.207066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.207828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.208297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.208768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.339799 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:51.347712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3c7bf969-9577-438d-8d3a-4987565f9c98 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.151821 Jul 21 23:00:51.348892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1246/2635] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:51 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:51.614899 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:51.615535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:51.621944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.622388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.623136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:51.623566 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:51.759408 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:51.767295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7bfd99f7-7714-4691-893c-b5d8053b74ba tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.157064 Jul 21 23:00:51.767846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1390/2636] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:51 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:52.364928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:52.365638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:52.371819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.372276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.373072 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.373514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.510147 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:52.518277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-35a9e52f-2b6c-4a9a-bc83-a0f332fe1b0d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.157332 Jul 21 23:00:52.518948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1247/2637] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:52 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:52.784600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:52.785328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:52.792002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.792446 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.793222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:52.793654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:52.921876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:52.930576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78c07b81-7f7d-4a25-92a5-4c00a9e68b88 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149879 Jul 21 23:00:52.931122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1391/2638] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:52 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:53.536793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:53.537410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:53.543942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.544392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.545190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.545626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.673078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:53.680935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5886018f-869c-48fb-866b-222101dac3c9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.148715 Jul 21 23:00:53.681500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1248/2639] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:53 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:53.947036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:53.947648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:53.954072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.954522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:53.955274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:53.955704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.091552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:54.100289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8e089721-4971-41d5-a333-35b1c372f10b tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.157125 Jul 21 23:00:54.100880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1392/2640] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:53 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:54.697822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:54.698367 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:54.704895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.705341 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.706102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:54.706529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:54.838600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:54.846460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-20e7b183-39df-4cc2-8f4c-fc0e71d43592 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152565 Jul 21 23:00:54.847029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1249/2641] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:54 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:55.117229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:55.117846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:55.124395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.124907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.125671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.126110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.258479 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:55.260773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:55.267697 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6bea986d-537f-4a4d-8600-ee4d23656857 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.154369 Jul 21 23:00:55.268466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1393/2642] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:55 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:55.863896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:55.864527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:55.866921 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=52 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:00:55.872308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.872787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:55.873548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:55.873988 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:56.001950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:56.010216 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d9a56148-4b72-41ee-a0c4-d48079cacd67 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150704 Jul 21 23:00:56.010783 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1250/2643] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:55 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:56.286414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:56.287022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:56.293670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:56.294126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:56.294896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:56.295336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:56.424835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:56.432853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-23db1588-9588-4080-ab7b-f6d03075213a tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150779 Jul 21 23:00:56.433838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1394/2644] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:56 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:57.027032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:57.027670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:57.034155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:57.034610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:57.035428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:57.035869 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:57.164561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:57.172425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9f1e9a34-fcc1-445c-ac91-407fdf9401e9 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149224 Jul 21 23:00:57.173025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1251/2645] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:57 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:57.449739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:57.450351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:57.456943 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:57.457451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:57.458227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:57.458664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:57.586956 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:57.594844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-84e05150-1604-4788-8b48-c0f1a6f84b04 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149000 Jul 21 23:00:57.595405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1395/2646] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:57 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:58.189466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:58.190195 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:58.196818 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:58.197276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:58.198036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:58.198476 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:58.330330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:58.338864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-675a0dd5-7efd-46b2-ae4f-5b87678dd92b tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.153226 Jul 21 23:00:58.339444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1252/2647] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:58 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:58.612539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:58.613310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:58.620149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:58.620637 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:58.621403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:58.621838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:58.748060 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:58.756751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ab820c96-670a-4bec-a6b3-7634a6c8c7f5 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148040 Jul 21 23:00:58.757320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1396/2648] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:58 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:59.356115 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:59.356747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:59.363674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:59.364116 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:59.364901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:59.365334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:59.494934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:59.502947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5f768bc7-d946-400e-9c9e-9e0d4cbe06db tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150670 Jul 21 23:00:59.504384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1253/2649] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:59 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:00:59.774139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:00:59.774685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:00:59.781052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:59.781502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:59.782397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:00:59.782829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:00:59.912157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:00:59.920036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3af70de6-b8f6-45c5-9236-f35debad5288 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150011 Jul 21 23:00:59.920630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1397/2650] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:00:59 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:00.521421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:00.522039 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:00.528820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:00.529273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:00.530033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:00.530472 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:00.659747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:00.667925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5b2c2f3a-d9ff-4825-aaaa-ac345f5cf8ca tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150932 Jul 21 23:01:00.668512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1254/2651] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:00 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:00.937974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:00.938586 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:00.946149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:00.946623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:00.947378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:00.947809 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:01.077120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:01.085568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4898bd6f-9d76-4f11-900d-eb1ae90afd8f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151419 Jul 21 23:01:01.086125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1398/2652] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:00 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:01.684919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:01.685466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:01.692370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:01.692857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:01.693622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:01.694060 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:01.822235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:01.830152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86295a62-f8fb-4fe4-a516-1da1f9008f58 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149156 Jul 21 23:01:01.830774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1255/2653] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:01 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:02.102478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:02.103087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:02.109552 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:02.109993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:02.110738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:02.111167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:02.240097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:02.247883 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1937b72d-1856-41c1-9b9f-fe3739a72d7d tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149262 Jul 21 23:01:02.248442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1399/2654] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:02 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:01:02.848303 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:02.848957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:02.855395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:02.855844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:02.856642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:02.857080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:02.981999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:02.990390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c3ae3dda-7b8e-4814-8076-ced79ac20414 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.146582 Jul 21 23:01:02.990958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1256/2655] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:02 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:03.264975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:03.265525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:03.272710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:03.273153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:03.273897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:03.274327 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:03.400206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:03.408130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-053a4bc8-58ed-43a9-8cae-b4ae778665e3 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.146966 Jul 21 23:01:03.408716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1400/2656] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:03 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:04.008529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:04.009181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:04.015523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:04.015968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:04.016747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:04.017176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:04.148156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:04.156055 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-445f80fc-11ad-4730-beec-9b95165943e3 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152324 Jul 21 23:01:04.156637 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1257/2657] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:04 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:04.426314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:04.426914 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:04.433762 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:04.433874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:04.434624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:04.435053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:04.561905 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:04.570187 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a0f5326e-9250-4f9c-8497-34a8a24ea3fc tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148386 Jul 21 23:01:04.570744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1401/2658] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:04 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:05.172750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:05.173362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:05.181373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:05.181822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:05.182580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:05.183008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:05.310262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:05.318956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bbebdd0f-f4bc-4c48-a3a1-393b30ab62dc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150058 Jul 21 23:01:05.319533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1258/2659] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:05 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:05.587088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:05.587698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:05.594176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:05.594623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:05.595377 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:05.595817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:05.728639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:05.736440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-abcdd932-326b-4de7-a332-3a26f06eafb4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.153286 Jul 21 23:01:05.737023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1402/2660] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:05 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:06.335568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:06.336160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:06.342867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:06.343293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:06.344045 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:06.344500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:06.481314 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:06.489858 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-51cf1844-1c63-436f-8d55-05717cb8ad19 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.158481 Jul 21 23:01:06.490712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1259/2661] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:06 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:06.754772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:06.755303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:06.761715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:06.762164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:06.762916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:06.763350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:06.892772 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:06.900728 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b38cc109-304a-4b61-a191-05bb77692724 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.150425 Jul 21 23:01:06.901293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1403/2662] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:06 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:07.513634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:07.514268 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:07.521097 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:07.521548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:07.522306 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:07.522735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:07.852046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:07.862207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-03d60588-d079-4617-8ff5-4e84019f874f tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.352451 Jul 21 23:01:07.862894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1260/2663] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:07 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:07.918233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:07.918853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:07.925612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:07.926063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:07.926831 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:07.927265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:08.080365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:08.091488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-68d0c4c8-58c2-43e3-83db-900b72ad562e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.177223 Jul 21 23:01:08.092305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1404/2664] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:07 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:08.880082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:08.880708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:08.887047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:08.887492 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:08.888237 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:08.888698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:08.902912 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=100 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:09.020220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:09.028074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3e9a222a-8d7e-465e-9a2c-456c59fd3578 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.152228 Jul 21 23:01:09.028654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1261/2665] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:08 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:09.109178 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:09.109795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:09.116291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.116779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.117541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:09.117982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:09.245252 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:09.253604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d20bebc2-d3a7-409e-b9ba-33953274b784 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.147867 Jul 21 23:01:09.254170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1405/2666] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:09 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:10.045649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:10.046238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:10.053212 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:10.053686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:10.054438 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:10.054872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:10.183399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:10.191451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-de14aafc-df85-4858-a3af-a6851c74ad5c tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.149672 Jul 21 23:01:10.192022 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1262/2667] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:10 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:10.270554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:10.271167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:10.277567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:10.278016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:10.278775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:10.279204 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:10.410118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:10.418275 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cbf392be-0396-484c-bba6-63d55b66a00e tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.151591 Jul 21 23:01:10.419071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1406/2668] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:10 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:11.208417 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:11.209088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:11.216280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.216768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.217542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.217979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.343836 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:11.351839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-76e605ce-9a77-4bb8-b324-56f628089bdc tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147316 Jul 21 23:01:11.352395 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1263/2669] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:11 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:11.435743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:11.436356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:11.443789 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.444235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.445023 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:11.445453 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:11.572353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:11.580172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d43f61fe-5212-4b14-af41-ecd61277d1f2 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.148274 Jul 21 23:01:11.580835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1407/2670] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:11 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:12.368402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:12.369054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:12.375519 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.375969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:12.376759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.377196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:12.511704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:12.520453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-08401acb-610c-4f58-85fe-e3f70234eebf tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155885 Jul 21 23:01:12.521069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1264/2671] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:12 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:12.598018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:12.598690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:12.604855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.605295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:12.606043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:12.606502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:12.737151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:12.745456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b9d1d397-d0cb-4ded-b853-e24ce2b3cf51 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152096 Jul 21 23:01:12.746026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1408/2672] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:12 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:13.537531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:13.538136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:13.544568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:13.545020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.545770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:13.546196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.672260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:13.680785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5fd7dbae-1561-47fb-bee4-f3c512db3dd0 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.147048 Jul 21 23:01:13.681335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1265/2673] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:13 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:13.763148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:13.763708 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:13.770478 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:13.770924 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.771679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:13.772108 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:13.903271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:13.911950 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-78bf80e0-1acb-4a4a-803a-901d3d81b62f tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.152675 Jul 21 23:01:13.912534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1409/2674] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:13 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:14.697710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:14.698257 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:14.704722 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.705173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.705931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.707086 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.840402 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:14.849485 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e3644d37-00ed-4639-bdc4-54f30d3846de tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.155599 Jul 21 23:01:14.850078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1266/2675] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:14 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:14.929039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:14.929648 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] [instance: 02526e73-3f8e-4ab0-a000-79f1250f9be2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:14.936089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.936561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.937309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:14.937733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:14.951799 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=100 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:01:15.066260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6a2a022db8b4ef98a8c4932f753240a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8abe8948c934248a448532711d4499b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:15.074093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-39b107f1-aa27-4cf2-8984-2d46d335ede4 tempest-VolumesSnapshotTestJSON-598834229 tempest-VolumesSnapshotTestJSON-598834229-project] 10.222.0.42 "GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2" status: 200 len: 1559 microversion: 2.1 time: 0.149025 Jul 21 23:01:15.074663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1410/2676] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:14 2022] GET /compute/v2.1/servers/02526e73-3f8e-4ab0-a000-79f1250f9be2 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:15.867727 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:15.868348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 5a0581a2-5f0c-492d-8051-d7a05bc96786] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:01:15.874886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:15.875340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:15.876128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:15.876595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:16.005170 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:01:16.012986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-058964ed-1488-4935-9bb7-359e120cf63a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786" status: 200 len: 1736 microversion: 2.1 time: 0.150303 Jul 21 23:01:16.013538 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1267/2677] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:01:15 2022] GET /compute/v2.1/servers/5a0581a2-5f0c-492d-8051-d7a05bc96786 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:01:16.028894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-924a1b42-6c13-4700-bd92-f6f120b0978d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '.version_select at 0x7ff1d8afab80>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:01:16.051784 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-924a1b42-6c13-4700-bd92-f6f120b0978d tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306354665" status: 202 len: 0 microversion: 2.1 time: 0.026555 Jul 21 23:01:16.052352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1411/2678] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:01:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306354665 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:01:16.939288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-e47b69bd-a8a5-4da8-8666-18b2c4ff37e2 req-16c253f3-a88e-4c4d-a332-30cdabfa7ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:01:16.948995 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e47b69bd-a8a5-4da8-8666-18b2c4ff37e2 req-16c253f3-a88e-4c4d-a332-30cdabfa7ea7 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:01:16.949525 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e47b69bd-a8a5-4da8-8666-18b2c4ff37e2 req-16c253f3-a88e-4c4d-a332-30cdabfa7ea7 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:01:16.960607 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-e47b69bd-a8a5-4da8-8666-18b2c4ff37e2 req-16c253f3-a88e-4c4d-a332-30cdabfa7ea7 service nova] Creating event network-changed:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 23:01:16.966934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-e47b69bd-a8a5-4da8-8666-18b2c4ff37e2 req-16c253f3-a88e-4c4d-a332-30cdabfa7ea7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031311 Jul 21 23:01:16.967535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1268/2679] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:02:23.273455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:02:23.274155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:02:27.812962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:02:27.813567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:02:44.602109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:44.602861 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:02:44.674737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-6498057d-cbca-4800-9ff7-18c710051ed4 req-54a72be1-9b7d-4cf8-a4ca-03336e917af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0581a2-5f0c-492d-8051-d7a05bc96786", "name": "network-vif-deleted", "tag": "f444299f-195d-4d7c-8da2-8582dbba10a0"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:02:44.684208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6498057d-cbca-4800-9ff7-18c710051ed4 req-54a72be1-9b7d-4cf8-a4ca-03336e917af1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:02:44.684686 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6498057d-cbca-4800-9ff7-18c710051ed4 req-54a72be1-9b7d-4cf8-a4ca-03336e917af1 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:02:44.695590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-6498057d-cbca-4800-9ff7-18c710051ed4 req-54a72be1-9b7d-4cf8-a4ca-03336e917af1 service nova] Creating event network-vif-deleted:f444299f-195d-4d7c-8da2-8582dbba10a0 for instance 5a0581a2-5f0c-492d-8051-d7a05bc96786 on hv-cinder-85069 Jul 21 23:02:44.700651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-6498057d-cbca-4800-9ff7-18c710051ed4 req-54a72be1-9b7d-4cf8-a4ca-03336e917af1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101218 Jul 21 23:02:44.701276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1412/2680] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:03:56.512728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:03:56.513285 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:03:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:04:23.789136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:04:23.789821 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:04:35.924736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:04:35.925315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:04:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:05:16.544953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR oslo.messaging._drivers.impl_rabbit [-] [67d8265e-b725-4e75-bdfa-c0870adcaa00] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 23:05:16.545653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=37 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:16.546621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=41 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:16.550962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:05:16.551541 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:05:16.559154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:05:16.559603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:05:16.560362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:05:16.560819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:05:16.574661 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] HTTP exception thrown: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Request method failure captured: Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 HTTP/1.1 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRTifTu9iFy6THmNw-yH4tX1513l4ml11M3TV4_vSPDJ7iN00GoqaconjYTAHgwnIJFnXr9H1jntu0qwuZLh8bQJbuuZ78IwAkZ9crt2q-Imi90zOVt8JeTG-UyLOKOvz8arXq3IsqRFW0m5vRbCaiLiQb1T55OGEtvgWdps0fghzM Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:05:16.576311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613f21f4b5164e6087e734f9b447e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: da46b59a0cb5430589aeef1693b2ce50 Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.578058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'eba1ec2e-bdda-4057-8958-97def6b80299'} Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:05:16.578953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.580410 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.581887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Returning 404 to user: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:05:16.581887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-39d89b00-ee07-4040-8a70-3bbb6d2511a0 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 404 len: 111 microversion: 2.20 time: 0.035082 Jul 21 23:05:16.581887 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1269/2681] 10.222.0.42 () {60 vars in 1279 bytes} [Thu Jul 21 23:05:16 2022] DELETE /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:05:16.584414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR oslo.messaging._drivers.impl_rabbit [-] [050e59f3-6068-4bda-bf8b-86018569c955] AMQP server on 10.222.0.42:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 21 23:05:16.584992 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:16.585844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:16.590431 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:05:16.591123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] [instance: eba1ec2e-bdda-4057-8958-97def6b80299] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:05:16.598567 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:05:16.599034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:05:16.599783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:05:16.600214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:05:16.615615 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] HTTP exception thrown: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Request method failure captured: Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 HTTP/1.1 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRTifTu9iFy6THmNw-yH4tX1513l4ml11M3TV4_vSPDJ7iN00GoqaconjYTAHgwnIJFnXr9H1jntu0qwuZLh8bQJbuuZ78IwAkZ9crt2q-Imi90zOVt8JeTG-UyLOKOvz8arXq3IsqRFW0m5vRbCaiLiQb1T55OGEtvgWdps0fghzM Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:05:16.617284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_613f21f4b5164e6087e734f9b447e961"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/613f21f4b5164e6087e734f9b447e961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 613f21f4b5164e6087e734f9b447e961 Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1524068780 Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: da46b59a0cb5430589aeef1693b2ce50 Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1524068780-project Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.619718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'eba1ec2e-bdda-4057-8958-97def6b80299'} Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:05:16.620621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. Jul 21 23:05:16.622569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:16.624084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] Returning 404 to user: Instance eba1ec2e-bdda-4057-8958-97def6b80299 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:05:16.624084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-51e9b8e0-a81d-4d47-b434-242af729d600 tempest-AttachVolumeShelveTestJSON-1524068780 tempest-AttachVolumeShelveTestJSON-1524068780-project] 10.222.0.42 "GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299" status: 404 len: 111 microversion: 2.20 time: 0.036229 Jul 21 23:05:16.624084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1413/2682] 10.222.0.42 () {60 vars in 1276 bytes} [Thu Jul 21 23:05:16 2022] GET /compute/v2.1/servers/eba1ec2e-bdda-4057-8958-97def6b80299 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:05:20.973819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] [67d8265e-b725-4e75-bdfa-c0870adcaa00] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 58490. Jul 21 23:05:21.075245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f64ab09-7c66-42cf-99aa-7e72fd26b45a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Action: 'create', calling method: .version_select at 0x7ff1d8c8fe50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-491874420", "metadata": {"Type": "work"}}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f64ab09-7c66-42cf-99aa-7e72fd26b45a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 121 Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:05:21.095069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-491874420", "metadata": {"Type": "work"}}} Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 23:05:21.096893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-491874420', 'metadata': {'Type': 'work'}}}} Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:05:21.098766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:05:21.100527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:05:21.102211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 23:05:21.102211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.102211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1f64ab09-7c66-42cf-99aa-7e72fd26b45a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:05:21.102211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1f64ab09-7c66-42cf-99aa-7e72fd26b45a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133879 Jul 21 23:05:21.102211 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1270/2683] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 23:05:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:05:21.106828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bfa127c-38e9-43b5-b60a-ef2b187867fe tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Action: 'create', calling method: .version_select at 0x7ff1d8afa040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1708825747", "metadata": {"Type": "work"}}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bfa127c-38e9-43b5-b60a-ef2b187867fe tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 120 Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:05:21.110139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1708825747", "metadata": {"Type": "work"}}} Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 23:05:21.111825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1708825747', 'metadata': {'Type': 'work'}}}} Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi '0' Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:05:21.113062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:05:21.114806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:05:21.116662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 23:05:21.116662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.116662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2bfa127c-38e9-43b5-b60a-ef2b187867fe tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:05:21.116662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2bfa127c-38e9-43b5-b60a-ef2b187867fe tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008950 Jul 21 23:05:21.116662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1414/2684] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 23:05:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:05:21.121859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-21240c01-822c-481e-8b2f-5c12253da9da tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Action: 'create', calling method: .version_select at 0x7ff1d89eddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2145126251", "metadata": {"Type": "work"}}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-21240c01-822c-481e-8b2f-5c12253da9da tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 119 Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:05:21.124383 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2145126251", "metadata": {"Type": "work"}}} Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 23:05:21.126126 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2145126251', 'metadata': {'Type': 'work'}}}} Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise error Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi '' Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:05:21.127349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 23:05:21.129114 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 23:05:21.130599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 23:05:21.130599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:05:21.130599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-21240c01-822c-481e-8b2f-5c12253da9da tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:05:21.130599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-21240c01-822c-481e-8b2f-5c12253da9da tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009216 Jul 21 23:05:21.130599 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1271/2685] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Jul 21 23:05:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 23:05:21.134785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-71d02bc6-8cd0-42d2-aa66-a79ac8179f93 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Calling method '.version_select at 0x7ff1dd149160>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:05:21.148353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] [050e59f3-6068-4bda-bf8b-86018569c955] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 58500. Jul 21 23:05:26.595277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:26.605535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:05:43.282670 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:05:43.283261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:05:47.823557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:05:47.824364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:05:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-2017883322 (ip 10.222.0.42) !!! Jul 21 23:06:04.159330 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:06:04.160087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/tempest-invalid-2017883322 (ip 10.222.0.42) !!! Jul 21 23:06:21.193822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:21.194572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:06:21.199957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e5686e52-8a7e-45be-bb95-a76d3714ad2b tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Calling method '.version_select at 0x7ff1dd1a6790>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:06:44.501976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-71d02bc6-8cd0-42d2-aa66-a79ac8179f93 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] HTTP exception thrown: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-71d02bc6-8cd0-42d2-aa66-a79ac8179f93 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322 HTTP/1.1 Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:06:44.503962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'tempest-invalid-2017883322'} Jul 21 23:06:44.505790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2017883322 could not be found. (HTTP 404) (Request-ID: req-f7b10d2c-8e0b-4b5a-92fa-c180920da610) Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.507270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:06:44.508958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:06:44.510769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-71d02bc6-8cd0-42d2-aa66-a79ac8179f93 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 404 to user: Volume tempest-invalid-2017883322 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-71d02bc6-8cd0-42d2-aa66-a79ac8179f93 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322" status: 404 len: 99 microversion: 2.1 time: 83.374598 Jul 21 23:06:44.512551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1415/2686] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:05:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322 => generated 99 bytes in 83376 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 23:06:44.643539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-e5686e52-8a7e-45be-bb95-a76d3714ad2b tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] HTTP exception thrown: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e5686e52-8a7e-45be-bb95-a76d3714ad2b tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322 HTTP/1.1 Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:06:44.645539 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'tempest-invalid-2017883322'} Jul 21 23:06:44.647301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2017883322 could not be found. (HTTP 404) (Request-ID: req-3294c6e0-97cb-4e35-9ca1-3bca9ac8eaff) Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.648546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:06:44.649853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:06:44.651718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2017883322 could not be found. Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e5686e52-8a7e-45be-bb95-a76d3714ad2b tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 404 to user: Volume tempest-invalid-2017883322 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e5686e52-8a7e-45be-bb95-a76d3714ad2b tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322" status: 404 len: 99 microversion: 2.1 time: 23.454973 Jul 21 23:06:44.653161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1272/2687] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:06:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2017883322 => generated 99 bytes in 23456 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 21 23:06:44.657910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2a1f6bbc-0770-401c-a54b-0461897006c9 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004449 Jul 21 23:06:44.658407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1416/2688] 10.222.0.42 () {58 vars in 1139 bytes} [Thu Jul 21 23:06:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 23:06:44.667987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-37e0f2e8-6bc9-420c-85d1-5b18189d10cf tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004383 Jul 21 23:06:44.668561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1273/2689] 10.222.0.42 () {58 vars in 1136 bytes} [Thu Jul 21 23:06:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 23:06:44.676961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2bbf4a1-9af1-4985-8551-74476d4a96c1 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Calling method '.version_select at 0x7ff1dd26baf0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:07:16.521046 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:07:16.521632 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:07:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:07:16.807886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-a2bbf4a1-9af1-4985-8551-74476d4a96c1 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] HTTP exception thrown: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2bbf4a1-9af1-4985-8551-74476d4a96c1 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/os-volumes/0f068115-47e4-4e7f-b392-a73456c79057 HTTP/1.1 Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:07:16.809886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '0f068115-47e4-4e7f-b392-a73456c79057'} Jul 21 23:07:16.811752 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. (HTTP 404) (Request-ID: req-873c3e3a-0e9d-4f98-8306-0eb1595c6c7b) Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:07:16.813372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 23:07:16.815220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 23:07:16.817372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a2bbf4a1-9af1-4985-8551-74476d4a96c1 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 404 to user: Volume 0f068115-47e4-4e7f-b392-a73456c79057 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a2bbf4a1-9af1-4985-8551-74476d4a96c1 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0f068115-47e4-4e7f-b392-a73456c79057" status: 404 len: 109 microversion: 2.1 time: 32.138034 Jul 21 23:07:16.819072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1417/2690] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:06:44 2022] DELETE /compute/v2.1/os-volumes/0f068115-47e4-4e7f-b392-a73456c79057 => generated 109 bytes in 32139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:07:16.823433 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2e00f39-039c-4205-ac1d-93b205c8b21a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Calling method '.version_select at 0x7ff1d88f8040>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:07:43.797654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:07:43.798580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38 (ip 10.222.0.42) !!! Jul 21 23:07:55.933999 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:07:55.934520 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:07:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:08:16.883871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c71805f7-9cd2-432d-b59a-b6bbd99db1a8 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Calling method '.version_select at 0x7ff1d8b6adc0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:08:44.692207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-a2e00f39-039c-4205-ac1d-93b205c8b21a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] HTTP exception thrown: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2e00f39-039c-4205-ac1d-93b205c8b21a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38 HTTP/1.1 Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:08:44.694207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '78641d6d-872c-45e5-926a-cf3d779cea38'} Jul 21 23:08:44.696558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. (HTTP 404) (Request-ID: req-016b6dff-7717-488e-a925-206179aed2f6) Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.699190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:08:44.700897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:08:44.702409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a2e00f39-039c-4205-ac1d-93b205c8b21a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 404 to user: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a2e00f39-039c-4205-ac1d-93b205c8b21a tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38" status: 404 len: 109 microversion: 2.1 time: 87.877846 Jul 21 23:08:44.704019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1274/2691] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 23:07:16 2022] GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38 => generated 109 bytes in 87879 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:08:44.913627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-c71805f7-9cd2-432d-b59a-b6bbd99db1a8 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] HTTP exception thrown: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c71805f7-9cd2-432d-b59a-b6bbd99db1a8 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Request method failure captured: Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38 HTTP/1.1 Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2duwhjIB9b8YVgMDDPhcaT6iAmiTX0raoyNSzu-zARpVWTKKjXsjO6AlYxAEwkRXPrsPrnL5B3-HMnZuQjluH6gTHQUhJSRMJN9B1lYQywIngLnfpgAD7dodhF7zTd3l3WQYaZlHYg7hnXQYWH7oYj6GpLJOpZ0jZer78AVqXqjg7Fc Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:08:44.916101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c53da2fff85471fb98fa44fa41a7bcd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 1c53da2fff85471fb98fa44fa41a7bcd Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesNegativeTest-1997916529 Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 2e9e0b67144442c7aaf11dbe2c42a344 Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesNegativeTest-1997916529-project Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '78641d6d-872c-45e5-926a-cf3d779cea38'} Jul 21 23:08:44.917730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. (HTTP 404) (Request-ID: req-e969cc93-7913-4690-9750-0ab68e924181) Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.918916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 23:08:44.920247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 23:08:44.921536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c71805f7-9cd2-432d-b59a-b6bbd99db1a8 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] Returning 404 to user: Volume 78641d6d-872c-45e5-926a-cf3d779cea38 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c71805f7-9cd2-432d-b59a-b6bbd99db1a8 tempest-VolumesNegativeTest-1997916529 tempest-VolumesNegativeTest-1997916529-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38" status: 404 len: 109 microversion: 2.1 time: 28.039197 Jul 21 23:08:44.922791 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1418/2692] 10.222.0.42 () {58 vars in 1244 bytes} [Thu Jul 21 23:08:16 2022] GET /compute/v2.1/os-volumes/78641d6d-872c-45e5-926a-cf3d779cea38 => generated 109 bytes in 28040 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:09:03.291640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:09:03.292142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:09:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:09:07.833863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:09:07.834475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:09:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:09:16.282635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:16.283113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:16.289387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:16.289834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:16.290589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:16.291028 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:16.318404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:09:16.407658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1e4cf258-0483-4632-bb8b-6ed602e577a1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 204 len: 0 microversion: 2.1 time: 0.130866 Jul 21 23:09:16.411614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1275/2693] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:09:16 2022] DELETE /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:09:16.421593 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:16.424313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:16.436545 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:16.437087 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:16.439032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:16.440085 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:16.615217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:16.623735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-90791258-2a10-45d4-9ceb-d461f70ed3c1 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1507 microversion: 2.1 time: 0.210819 Jul 21 23:09:16.624355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1419/2694] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:16 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:17.371822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-5cce4d3d-6224-4239-9f85-b80c05294eaf req-cea2b681-5182-41e6-939e-d9d5d32d3178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02526e73-3f8e-4ab0-a000-79f1250f9be2", "name": "network-vif-deleted", "tag": "7bff8f72-d3ae-4525-8a5a-82fcdee1ec61"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:17.380089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-5cce4d3d-6224-4239-9f85-b80c05294eaf req-cea2b681-5182-41e6-939e-d9d5d32d3178 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:17.380554 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-5cce4d3d-6224-4239-9f85-b80c05294eaf req-cea2b681-5182-41e6-939e-d9d5d32d3178 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:17.391790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-5cce4d3d-6224-4239-9f85-b80c05294eaf req-cea2b681-5182-41e6-939e-d9d5d32d3178 service nova] Creating event network-vif-deleted:7bff8f72-d3ae-4525-8a5a-82fcdee1ec61 for instance 02526e73-3f8e-4ab0-a000-79f1250f9be2 on hv-cinder-85069 Jul 21 23:09:17.396826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-5cce4d3d-6224-4239-9f85-b80c05294eaf req-cea2b681-5182-41e6-939e-d9d5d32d3178 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222433 Jul 21 23:09:17.397399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1276/2695] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:17.641095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:17.641713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:17.648412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:17.648900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:17.649663 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:17.650105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:17.782734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:17.790653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7417c4e2-2f72-4480-8d33-abd33979ba43 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1507 microversion: 2.1 time: 0.153414 Jul 21 23:09:17.791239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1420/2696] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:17 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:18.810150 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:18.811107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:18.823284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:18.823997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:18.824808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:18.825240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:18.964690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:18.972745 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-24405d6a-673e-4774-8a98-a7d2d0dfaa0a tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1507 microversion: 2.1 time: 0.167635 Jul 21 23:09:18.973735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1277/2697] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:18 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:09:19.990815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:19.991424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:19.998296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:19.998738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:19.999765 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:20.000253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:20.140602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:20.148362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52ddc3bf-0a7f-40c9-a14b-0bdc7c4f2884 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 200 len: 1507 microversion: 2.1 time: 0.161263 Jul 21 23:09:20.149208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1421/2698] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:19 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:20.340950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-fce268cb-880f-437c-acdf-4fbf7a82e82d req-af945576-aac7-4e30-87d6-23061d2f94d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a02651-3341-4946-b6e2-4384b05df109", "name": "network-vif-deleted", "tag": "5c6a29a4-9595-4866-a09d-cb85249f6fb8"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:20.351908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-fce268cb-880f-437c-acdf-4fbf7a82e82d req-af945576-aac7-4e30-87d6-23061d2f94d6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:20.353323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-fce268cb-880f-437c-acdf-4fbf7a82e82d req-af945576-aac7-4e30-87d6-23061d2f94d6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:20.376414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-fce268cb-880f-437c-acdf-4fbf7a82e82d req-af945576-aac7-4e30-87d6-23061d2f94d6 service nova] Creating event network-vif-deleted:5c6a29a4-9595-4866-a09d-cb85249f6fb8 for instance c0a02651-3341-4946-b6e2-4384b05df109 on hv-cinder-85069 Jul 21 23:09:20.384185 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-fce268cb-880f-437c-acdf-4fbf7a82e82d req-af945576-aac7-4e30-87d6-23061d2f94d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047086 Jul 21 23:09:20.386208 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1278/2699] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:21.165838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:21.167249 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: c0a02651-3341-4946-b6e2-4384b05df109] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:21.173543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.174002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.174769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.175301 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.189577 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] HTTP exception thrown: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Request method failure captured: Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 HTTP/1.1 Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dRa1aevr8hfzH9tBnuI-nZ1o2-tjU0GUNavGBtGQWU6Bs5pOzyJHT4Skp5b3-0DBBU3X8C68BEsgTbyQezGagdfLsbdMxTPByDRQyFIC1JVM9KlTtTt--Zk_zhn_jbNU9KTZSYXlKXSPLUxJPykAXr1INDiMeiVGu8oNVWZ5LpTsug Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 0b2f768290ea43cb98b058067268674d Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:09:21.191101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b2f768290ea43cb98b058067268674d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b2f768290ea43cb98b058067268674d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 0b2f768290ea43cb98b058067268674d Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: f93bd44f2fbc4be4be905c8b8ae0e343 Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. Jul 21 23:09:21.192817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'c0a02651-3341-4946-b6e2-4384b05df109'} Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:09:21.193704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. Jul 21 23:09:21.195189 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:21.196530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Returning 404 to user: Instance c0a02651-3341-4946-b6e2-4384b05df109 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:09:21.196530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b5620cdc-b301-4254-9f6f-cd8f76f9bd64 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jul 21 23:09:21.196530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1422/2700] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:21 2022] GET /compute/v2.1/servers/c0a02651-3341-4946-b6e2-4384b05df109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:09:21.201754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:21.202337 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:21.208697 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.209145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.209895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.210329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.238075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:09:21.332646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-32ac82b7-935c-4795-9185-5ff3fe42a535 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "DELETE /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 204 len: 0 microversion: 2.1 time: 0.134746 Jul 21 23:09:21.333258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1279/2701] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:09:21 2022] DELETE /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:09:21.345878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:21.346763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:21.353063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.353958 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.354818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:21.355418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:21.497018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:21.504706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-22ac2436-0fee-47d5-b66f-6d178700e04e tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1521 microversion: 2.1 time: 0.165133 Jul 21 23:09:21.505385 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1423/2702] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:21 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:22.400180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-0fb41111-57ec-4203-a689-fb100603debd req-85e0b45c-23c3-4e11-8d50-eb06c0ea7fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "346cdaf4-2c29-4dd7-aae1-06e8e7954ed8", "name": "network-vif-deleted", "tag": "661043a8-67a1-4492-a79b-152142d627f0"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:22.411084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-0fb41111-57ec-4203-a689-fb100603debd req-85e0b45c-23c3-4e11-8d50-eb06c0ea7fe8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:22.412591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-0fb41111-57ec-4203-a689-fb100603debd req-85e0b45c-23c3-4e11-8d50-eb06c0ea7fe8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:22.425874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-0fb41111-57ec-4203-a689-fb100603debd req-85e0b45c-23c3-4e11-8d50-eb06c0ea7fe8 service nova] Creating event network-vif-deleted:661043a8-67a1-4492-a79b-152142d627f0 for instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 on hv-cinder-85069 Jul 21 23:09:22.433741 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-0fb41111-57ec-4203-a689-fb100603debd req-85e0b45c-23c3-4e11-8d50-eb06c0ea7fe8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037618 Jul 21 23:09:22.434332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1280/2703] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:22.522502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:22.523317 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:22.531217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:22.531745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:22.532605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:22.533161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:22.575878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:22.576334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:22.576857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lazy-loading 'fault' on Instance uuid 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:09:22.626372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f93bd44f2fbc4be4be905c8b8ae0e343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2f768290ea43cb98b058067268674d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:22.634240 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a059586d-b526-4c21-b6c4-579ad2fcf206 tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 200 len: 1312 microversion: 2.1 time: 0.115937 Jul 21 23:09:22.635423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1424/2704] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:22 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:23.653762 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:23.654874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] [instance: 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:23.661641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:23.662895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:23.663040 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:23.663435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:23.677997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] HTTP exception thrown: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Request method failure captured: Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 HTTP/1.1 Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dRa1aevr8hfzH9tBnuI-nZ1o2-tjU0GUNavGBtGQWU6Bs5pOzyJHT4Skp5b3-0DBBU3X8C68BEsgTbyQezGagdfLsbdMxTPByDRQyFIC1JVM9KlTtTt--Zk_zhn_jbNU9KTZSYXlKXSPLUxJPykAXr1INDiMeiVGu8oNVWZ5LpTsug Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 0b2f768290ea43cb98b058067268674d Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:09:23.679929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b2f768290ea43cb98b058067268674d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b2f768290ea43cb98b058067268674d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b2f768290ea43cb98b058067268674d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 0b2f768290ea43cb98b058067268674d Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-683781355 Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: f93bd44f2fbc4be4be905c8b8ae0e343 Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-ServerRescueNegativeTestJSON-683781355-project Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. Jul 21 23:09:23.681524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '346cdaf4-2c29-4dd7-aae1-06e8e7954ed8'} Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:09:23.682390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. Jul 21 23:09:23.684430 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:09:23.686531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] Returning 404 to user: Instance 346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:09:23.686531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-348e58f0-c53f-4ef5-a8e2-510d1a120ffb tempest-ServerRescueNegativeTestJSON-683781355 tempest-ServerRescueNegativeTestJSON-683781355-project] 10.222.0.42 "GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8" status: 404 len: 111 microversion: 2.1 time: 0.032902 Jul 21 23:09:23.686531 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1281/2705] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:23 2022] GET /compute/v2.1/servers/346cdaf4-2c29-4dd7-aae1-06e8e7954ed8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:09:24.169054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:09:24.169541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:09:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:09:32.967732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=14 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:32.968592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=34 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:33.114423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8951f733-c9a3-49bf-a67a-ca07449b5814 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: .version_select at 0x7ff1d8b6ae50>, body: {"keypair": {"name": "tempest-keypair-233183350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKR297QNQXCOGn5nhIN961rGb2z2bqHpYwzCoBVwSKz9napQWo3+ls/r7NZjG7lgRhhy9Jeq0w7QpfTe0RFahTVSnMiOS2xLuiM6B2xRvFZzuA7hgVE+9EZvkH7SUNY8Mw=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:33.146754 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-8951f733-c9a3-49bf-a67a-ca07449b5814 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:09:33.161277 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-8951f733-c9a3-49bf-a67a-ca07449b5814 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for user 8a7e4fed38914f91beae1c094d73163f and project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:09:33.193078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8951f733-c9a3-49bf-a67a-ca07449b5814 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231571 Jul 21 23:09:33.199630 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1425/2706] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:09:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:34.954414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1903919544", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26d482a8-3a9b-4cc3-a551-90512775de63"}], "security_groups": [{"name": "tempest-securitygroup--216028759"}], "key_name": "tempest-keypair-233183350", "user_data": "}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:34.963080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:34.964503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:35.099037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] validate_networks() for [('26d482a8-3a9b-4cc3-a551-90512775de63', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:09:35.667473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:09:35.667906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:09:35.668414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:09:35.668872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:09:35.669290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:09:35.679548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:35.680008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:35.680857 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:35.681298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:35.698908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:09:35.702949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for user 8a7e4fed38914f91beae1c094d73163f and project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:09:35.715008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:09:35.717327 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:09:35.768350 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-46f052c7-b3fb-4ea4-91e8-53c4227bbd6a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.818223 Jul 21 23:09:35.769023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1282/2707] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:09:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:09:35.780667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4660f0b4-bf6d-42eb-a646-6ca4a3d19fb6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:35.781282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4660f0b4-bf6d-42eb-a646-6ca4a3d19fb6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:35.878683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-4660f0b4-bf6d-42eb-a646-6ca4a3d19fb6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:35.890830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4660f0b4-bf6d-42eb-a646-6ca4a3d19fb6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1237 microversion: 2.1 time: 0.114621 Jul 21 23:09:35.893450 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1426/2708] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:35 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:36.536497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-874395657", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:36.592817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] validate_networks() for None {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:09:36.884840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:09:36.885274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:09:36.885814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:09:36.886229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:09:36.886701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:09:36.900428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:36.901577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:36.902486 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:36.902925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:36.909198 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:36.909933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:36.917645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:36.918174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:36.919010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:36.919519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:36.920443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Getting quotas for project 19d7982e502a432da43d049b5bde2888. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:09:36.924420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Getting quotas for user c114dd46ee13454f90d6e91eba795751 and project 19d7982e502a432da43d049b5bde2888. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:09:36.936800 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:09:36.939307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:09:36.984041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-736a035c-e18e-45e7-9f5b-e3a7997c5d2f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.451836 Jul 21 23:09:36.984226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:36.984828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1283/2709] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:09:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:09:36.996855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-20291dea-a5cf-4680-a2bc-4c7c01fd8dc8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1289 microversion: 2.1 time: 0.091363 Jul 21 23:09:36.997066 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f8f5c000-69bc-4dd3-9fca-6ca2227a5c04 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:36.997633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f8f5c000-69bc-4dd3-9fca-6ca2227a5c04 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:37.000595 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1427/2710] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:36 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:09:37.055110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f8f5c000-69bc-4dd3-9fca-6ca2227a5c04 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:37.063192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f8f5c000-69bc-4dd3-9fca-6ca2227a5c04 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1214 microversion: 2.1 time: 0.070629 Jul 21 23:09:37.064026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1284/2711] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:36 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:38.015445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:38.016694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:38.023781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:38.024766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:38.025790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:38.027086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:38.081026 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:38.081844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:38.089456 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:38.090010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:38.090889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:38.091577 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:38.169530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:38.177310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5d1f5dde-f69b-4276-b41d-ac9386f02faf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.166103 Jul 21 23:09:38.177881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1428/2712] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:38 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:09:38.456082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:38.465249 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e58c0fc2-51a0-4dcc-8927-6ae2f1a609aa tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1266 microversion: 2.1 time: 0.388028 Jul 21 23:09:38.465820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1285/2713] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:38 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:39.024414 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-29fc51a6-ba64-4037-89ad-5d213b2d7e98 req-154475d4-d58a-4c2b-9812-48953232a0bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd1b861-8e14-4d14-91b5-b500a09df984", "tag": "9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:39.051542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-29fc51a6-ba64-4037-89ad-5d213b2d7e98 req-154475d4-d58a-4c2b-9812-48953232a0bd service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:39.051984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-29fc51a6-ba64-4037-89ad-5d213b2d7e98 req-154475d4-d58a-4c2b-9812-48953232a0bd service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:39.077161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-29fc51a6-ba64-4037-89ad-5d213b2d7e98 req-154475d4-d58a-4c2b-9812-48953232a0bd service nova] Creating event network-changed:9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7 for instance dcd1b861-8e14-4d14-91b5-b500a09df984 on hv-cinder-85069 Jul 21 23:09:39.083506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-29fc51a6-ba64-4037-89ad-5d213b2d7e98 req-154475d4-d58a-4c2b-9812-48953232a0bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083485 Jul 21 23:09:39.084803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1429/2714] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:39.195862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:39.196729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:39.208137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:39.208752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:39.210049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:39.210616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:39.450385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:39.459565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0656f395-c94d-4679-a955-424d50fe0d43 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.268239 Jul 21 23:09:39.460425 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1286/2715] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:39 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:09:39.483352 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:39.484058 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:39.492918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:39.494195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:39.495537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:39.496210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:39.705948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:39.714154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8a34a41b-5792-4a7c-83bc-ef85829129f1 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.234668 Jul 21 23:09:39.714931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1430/2716] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:39 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:40.163701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-e76c559a-73a5-4d3d-8f02-5a2affb44030 req-fa9e9f3b-769f-4523-a856-3ea1558241c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66251c1f-44f5-4c32-bffd-4602b7cf9352", "tag": "67b302de-4f89-4fc9-a88a-a9d3c7c43573"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:40.172631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e76c559a-73a5-4d3d-8f02-5a2affb44030 req-fa9e9f3b-769f-4523-a856-3ea1558241c9 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:40.173071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-e76c559a-73a5-4d3d-8f02-5a2affb44030 req-fa9e9f3b-769f-4523-a856-3ea1558241c9 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:40.184187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-e76c559a-73a5-4d3d-8f02-5a2affb44030 req-fa9e9f3b-769f-4523-a856-3ea1558241c9 service nova] Creating event network-changed:67b302de-4f89-4fc9-a88a-a9d3c7c43573 for instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 on hv-cinder-85069 Jul 21 23:09:40.189273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-e76c559a-73a5-4d3d-8f02-5a2affb44030 req-fa9e9f3b-769f-4523-a856-3ea1558241c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172945 Jul 21 23:09:40.189845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1287/2717] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:40.477944 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:40.478744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:40.486639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:40.487088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:40.487853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:40.488289 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:40.702921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:40.710817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-43a60c9b-d503-4373-ab35-20831f66794a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.237463 Jul 21 23:09:40.711594 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1431/2718] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:40 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:40.733721 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:40.734434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:40.741019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:40.741469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:40.742233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:40.743165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:40.950588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:40.958311 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-750bec41-a7da-4786-9b40-3f84a6b1d070 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.230891 Jul 21 23:09:40.959032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1288/2719] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:40 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:41.728309 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:41.729461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:41.735898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:41.736343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:41.737165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:41.737601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:41.877846 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:41.885324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ae0659f-f9a1-48f1-93e6-53cd1cd6a5b3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.161075 Jul 21 23:09:41.885874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1432/2720] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:41 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:41.976501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:41.977121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:41.984421 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:41.984901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:41.985654 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:41.986087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:42.117322 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:42.126263 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-24c09925-cee1-4815-8831-3cdbb2d90563 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.153641 Jul 21 23:09:42.126826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1289/2721] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:41 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:42.901345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:42.901959 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:42.908433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:42.908908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:42.909661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:42.910096 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:43.039020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:43.046525 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-571107c9-e08a-4539-b7f6-43a8782a8aa5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.149208 Jul 21 23:09:43.047088 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1433/2722] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:42 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:43.142936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:43.143477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:43.149941 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:43.150385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:43.151985 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:43.152420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:43.281636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:43.289094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bd8f90df-7baa-420d-a3cb-d348b2acde27 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.150066 Jul 21 23:09:43.289649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1290/2723] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:43 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:44.063601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:44.064207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:44.070672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:44.071119 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:44.071862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:44.072906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:44.202557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:44.210177 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-480c5d14-715d-4c69-9a52-0fbd726ea2fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.150411 Jul 21 23:09:44.210804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1434/2724] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:44 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:44.305894 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:44.306517 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:44.313825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:44.314206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:44.314982 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:44.315426 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:44.445653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:44.453132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3a11a898-bbb9-4481-b9e2-deade464ac7f tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.151296 Jul 21 23:09:44.453690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1291/2725] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:44 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:45.226305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:45.226925 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:45.233371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:45.233820 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:45.234572 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:45.235009 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:45.366729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:45.374653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fd3f8686-df47-400b-afd8-d0bb911f4e42 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.152226 Jul 21 23:09:45.375209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1435/2726] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:45 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:45.470056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:45.470677 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:45.477348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:45.477747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:45.478537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:45.478979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:45.609801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:45.617080 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-77516656-5aeb-41bd-8d94-63b1e6affb4b tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.150910 Jul 21 23:09:45.617636 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1292/2727] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:45 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:46.106734 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:46.170517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-24b057a5-badc-4fd8-9921-c0d3e64fe79b req-f410bf70-c306-47ee-b244-09f4e446cbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b861-8e14-4d14-91b5-b500a09df984", "name": "network-vif-plugged", "status": "completed", "tag": "9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:46.178876 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-24b057a5-badc-4fd8-9921-c0d3e64fe79b req-f410bf70-c306-47ee-b244-09f4e446cbc8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:46.179321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-24b057a5-badc-4fd8-9921-c0d3e64fe79b req-f410bf70-c306-47ee-b244-09f4e446cbc8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:46.190229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-24b057a5-badc-4fd8-9921-c0d3e64fe79b req-f410bf70-c306-47ee-b244-09f4e446cbc8 service nova] Creating event network-vif-plugged:9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7 for instance dcd1b861-8e14-4d14-91b5-b500a09df984 on hv-cinder-85069 Jul 21 23:09:46.195231 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-24b057a5-badc-4fd8-9921-c0d3e64fe79b req-f410bf70-c306-47ee-b244-09f4e446cbc8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093733 Jul 21 23:09:46.195996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1436/2728] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:46.392232 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:46.392866 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:46.398797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:46.399240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:46.399997 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:46.400506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:46.556238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:46.564006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0dbd9c0d-f61b-41b0-8709-2c10e2af44e5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.175833 Jul 21 23:09:46.564591 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1293/2729] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:46 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:46.635229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:46.635835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:46.641903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:46.642343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:46.643103 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:46.643533 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:46.772614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:46.780796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-713d60e1-1f23-4d69-9930-7bde7065c4e3 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.150265 Jul 21 23:09:46.781351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1437/2730] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:46 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:47.580766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:47.581393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:47.583324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:47.584010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=14 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:09:47.590793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:47.591250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:47.592053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:47.592656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:47.726131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:47.734740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ffe5bcf0-efe8-4b73-9102-f1e65572224e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1362 microversion: 2.1 time: 0.157783 Jul 21 23:09:47.736803 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1294/2731] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:47 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:47.797625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:47.798265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:47.804664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:47.805110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:47.805870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:47.806303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:47.943903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:47.952359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-53267772-c14c-4d7f-8bd5-951d0bffe78d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.158836 Jul 21 23:09:47.952962 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1438/2732] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:47 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:48.209627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-542df61c-4ebc-459a-a83b-ea7496fa228e req-579214c7-88c4-4d11-be73-1a6216d65d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66251c1f-44f5-4c32-bffd-4602b7cf9352", "name": "network-vif-plugged", "status": "completed", "tag": "67b302de-4f89-4fc9-a88a-a9d3c7c43573"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:48.218171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-542df61c-4ebc-459a-a83b-ea7496fa228e req-579214c7-88c4-4d11-be73-1a6216d65d63 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.218616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-542df61c-4ebc-459a-a83b-ea7496fa228e req-579214c7-88c4-4d11-be73-1a6216d65d63 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.230020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-542df61c-4ebc-459a-a83b-ea7496fa228e req-579214c7-88c4-4d11-be73-1a6216d65d63 service nova] Creating event network-vif-plugged:67b302de-4f89-4fc9-a88a-a9d3c7c43573 for instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 on hv-cinder-85069 Jul 21 23:09:48.234904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-542df61c-4ebc-459a-a83b-ea7496fa228e req-579214c7-88c4-4d11-be73-1a6216d65d63 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028966 Jul 21 23:09:48.235467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1295/2733] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:48.751433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:48.751971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:48.758134 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.758590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.759348 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.759785 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.890704 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:48.898164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f3b2861c-61bc-4c6d-a7d8-50436595b0c0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1548 microversion: 2.1 time: 0.150660 Jul 21 23:09:48.898727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1439/2734] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:48 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:48.917151 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:48.917744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:48.924067 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.924536 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.925292 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.925723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.969986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:48.970623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:48.976683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.977128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:48.977874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:48.978474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:49.008242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-845d6a6a-b982-4ba1-a5df-1d2af5a146a7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096714 Jul 21 23:09:49.008896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1296/2735] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:09:48 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:09:49.113145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:49.121393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a56106c0-b984-41c1-8f65-988ce208b8ec tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1314 microversion: 2.1 time: 0.155317 Jul 21 23:09:49.121982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1440/2736] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:48 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:09:49.942000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-8b794793-0af8-4f9b-937a-80c13cd59288 req-a68cf646-d2ab-4d6c-90aa-354350eb39a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd1b861-8e14-4d14-91b5-b500a09df984", "tag": "9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:49.950698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-8b794793-0af8-4f9b-937a-80c13cd59288 req-a68cf646-d2ab-4d6c-90aa-354350eb39a2 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:49.951265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-8b794793-0af8-4f9b-937a-80c13cd59288 req-a68cf646-d2ab-4d6c-90aa-354350eb39a2 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:49.962850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-8b794793-0af8-4f9b-937a-80c13cd59288 req-a68cf646-d2ab-4d6c-90aa-354350eb39a2 service nova] Creating event network-changed:9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7 for instance dcd1b861-8e14-4d14-91b5-b500a09df984 on hv-cinder-85069 Jul 21 23:09:49.968004 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-8b794793-0af8-4f9b-937a-80c13cd59288 req-a68cf646-d2ab-4d6c-90aa-354350eb39a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030191 Jul 21 23:09:49.968956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1297/2737] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:50.138045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:50.138639 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:50.145485 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.145937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.146768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.147265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.295063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:50.302863 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b6e2ca01-89fe-4139-a116-33e6d6d3de1c tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1464 microversion: 2.1 time: 0.168676 Jul 21 23:09:50.303425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1441/2738] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:50 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1464 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:50.344037 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:50.344660 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:50.350876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.351324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.352153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.352689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.381747 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:09:50.476514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7855e704-4bf4-43c6-8b72-cd0f2b96c7d9 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "DELETE /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 204 len: 0 microversion: 2.1 time: 0.136816 Jul 21 23:09:50.480570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1298/2739] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:09:50 2022] DELETE /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:09:50.486945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:50.487896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:50.495473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.496059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.497007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:50.498158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:50.638548 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:50.646035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-70bff9b2-f46d-4326-a407-ddff8e872eac tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1470 microversion: 2.1 time: 0.163301 Jul 21 23:09:50.646590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1442/2740] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:50 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:51.663881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:51.664647 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:51.671163 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:51.671613 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:51.672373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:51.672837 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:51.806953 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:51.814447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0b60d26e-28ab-4f8c-9b79-9f71a9a32209 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1470 microversion: 2.1 time: 0.155039 Jul 21 23:09:51.815020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1299/2741] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:51 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:52.449362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-bf509c08-b28c-43af-bf7f-730634c99dd5 req-8f5577d8-1a11-430e-be1b-f14cc0954158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66251c1f-44f5-4c32-bffd-4602b7cf9352", "name": "network-vif-deleted", "tag": "67b302de-4f89-4fc9-a88a-a9d3c7c43573"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:09:52.457932 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-bf509c08-b28c-43af-bf7f-730634c99dd5 req-8f5577d8-1a11-430e-be1b-f14cc0954158 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:52.458386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-bf509c08-b28c-43af-bf7f-730634c99dd5 req-8f5577d8-1a11-430e-be1b-f14cc0954158 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:52.471160 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-bf509c08-b28c-43af-bf7f-730634c99dd5 req-8f5577d8-1a11-430e-be1b-f14cc0954158 service nova] Creating event network-vif-deleted:67b302de-4f89-4fc9-a88a-a9d3c7c43573 for instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 on hv-cinder-85069 Jul 21 23:09:52.476082 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-bf509c08-b28c-43af-bf7f-730634c99dd5 req-8f5577d8-1a11-430e-be1b-f14cc0954158 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030497 Jul 21 23:09:52.480974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1443/2742] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:09:52.831266 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:52.831913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:52.839366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:52.839872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:52.840703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:52.841294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:52.873453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:52.873904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:52.874816 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lazy-loading 'fault' on Instance uuid 66251c1f-44f5-4c32-bffd-4602b7cf9352 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:09:52.918543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c114dd46ee13454f90d6e91eba795751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d7982e502a432da43d049b5bde2888', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:09:52.926124 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4b5bb9bd-f98a-4dae-9612-52f2f453e711 tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 200 len: 1304 microversion: 2.1 time: 0.098809 Jul 21 23:09:52.926693 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1300/2743] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:52 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:09:53.944145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:09:53.944875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] [instance: 66251c1f-44f5-4c32-bffd-4602b7cf9352] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:09:53.951100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:53.951543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:53.952316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:09:53.952769 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:09:53.966019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] HTTP exception thrown: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Request method failure captured: Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 HTTP/1.1 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dyuSONEutBuj_6RNpuLW8K1fQFAzEfj0Kw7DEP8n4-e6ttwEG1b2_Nih4Y4fvHbpL4oNMyt54qh_QexoxCGtr_3HsTBoYR43n7GBc8m-HRZXN6I-8cpU7UtoMce-ONstBhIsBMObtoKBpUQRxd4oywgFRzHN5-zX2RDnsZnZHLGhuM Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 19d7982e502a432da43d049b5bde2888 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-VolumesNegativeTest-522994315 Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:09:53.967588 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/19d7982e502a432da43d049b5bde2888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/19d7982e502a432da43d049b5bde2888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_19d7982e502a432da43d049b5bde2888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/19d7982e502a432da43d049b5bde2888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-VolumesNegativeTest-522994315 Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 19d7982e502a432da43d049b5bde2888 Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-VolumesNegativeTest-522994315 Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-VolumesNegativeTest-522994315-project Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: c114dd46ee13454f90d6e91eba795751 Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-VolumesNegativeTest-522994315-project Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. Jul 21 23:09:53.969409 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '66251c1f-44f5-4c32-bffd-4602b7cf9352'} Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:09:53.970467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. Jul 21 23:09:53.972393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:09:53.974139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] Returning 404 to user: Instance 66251c1f-44f5-4c32-bffd-4602b7cf9352 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:09:53.974139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-49557425-1fac-4112-a046-401f0d43627d tempest-VolumesNegativeTest-522994315 tempest-VolumesNegativeTest-522994315-project] 10.222.0.42 "GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352" status: 404 len: 111 microversion: 2.1 time: 0.029647 Jul 21 23:09:53.974139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1444/2744] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:09:53 2022] GET /compute/v2.1/servers/66251c1f-44f5-4c32-bffd-4602b7cf9352 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:10:26.032880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:26.033454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:26.035458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:26.036103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:26.042316 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:26.042767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:26.043602 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:26.044065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:26.069236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3445cd1b-e9ac-4482-bc15-37e40b93a760 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/ips" status: 200 len: 146 microversion: 2.1 time: 0.040473 Jul 21 23:10:26.069794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1301/2745] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:10:26 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:10:29.913838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5958b594-8677-40a8-897c-a4460ab2a82d"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:10:29.914887 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:29.917713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:29.918365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=92 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:29.924326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:29.924796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:29.925559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:29.925991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:30.188761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a380709f-0829-455e-b154-0e642bfabdce tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278718 Jul 21 23:10:30.189376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1445/2746] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:10:29 2022] POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:10:36.530083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:10:36.530608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:10:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:10:37.670187 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-673eabb6-093c-4a12-9a81-71bd33afcb87 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:10:37.672742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:37.673380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:10:37.678915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-673eabb6-093c-4a12-9a81-71bd33afcb87 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:37.679366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-673eabb6-093c-4a12-9a81-71bd33afcb87 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:37.739545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-673eabb6-093c-4a12-9a81-71bd33afcb87 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Going to try to stop instance {{(pid=124534) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 23:10:37.783993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-673eabb6-093c-4a12-9a81-71bd33afcb87 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action" status: 202 len: 0 microversion: 2.1 time: 0.117542 Jul 21 23:10:37.784621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1302/2747] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:10:37 2022] POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:10:37.793778 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:37.794471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:37.800751 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:37.801244 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:37.801986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:37.802420 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:37.937355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:37.945951 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-35b4cf1e-0943-4eaa-aa39-7e06dbb66ce0 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.156839 Jul 21 23:10:37.946521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1446/2748] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:37 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:38.964627 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:38.965326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:38.971885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:38.972333 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:38.973107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:38.973540 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:39.105808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:39.113638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-79a2d01b-9b71-48e1-8359-e2511b26ca02 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.153844 Jul 21 23:10:39.114192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1303/2749] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:38 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:40.131604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:40.132217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:40.139582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:40.140033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:40.140823 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:40.141259 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:40.268298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:40.276323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a360df81-0492-4cdb-91f4-0255c26e6729 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.148726 Jul 21 23:10:40.276910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1447/2750] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:40 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:41.293199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:41.293815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:41.300644 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:41.301093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:41.301846 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:41.302279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:41.671876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:41.679690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2afd63c9-4110-4c1f-a655-21a5ad661e35 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.390379 Jul 21 23:10:41.680250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1304/2751] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:41 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:42.698007 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:42.698550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:42.705036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:42.705488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:42.706247 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:42.706679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:42.833623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:42.841712 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-52c40d2e-d68a-4c4b-bacd-69a6ad6f0756 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.148276 Jul 21 23:10:42.842295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1448/2752] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:42 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:43.858396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:43.859001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:43.865546 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:43.865993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:43.866832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:43.867274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:43.994563 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:44.002467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8760cdd3-108b-4691-96e3-fd27b673f27e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.147857 Jul 21 23:10:44.002962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1305/2753] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:43 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:45.019673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:45.020315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:45.027002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:45.027451 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:45.028208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:45.028676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:45.154018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:45.161917 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-28a3b899-610c-4573-ae86-40740d30786a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.146082 Jul 21 23:10:45.162476 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1449/2754] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:45 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:46.179499 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:46.180129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:46.187213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:46.187655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:46.188408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:46.188865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:46.319444 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:46.327371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0f3af426-9df5-4f5a-b34c-a8d2920a13b9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.151905 Jul 21 23:10:46.327933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1306/2755] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:46 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:47.344222 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:47.344854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:47.351223 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:47.351715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:47.352468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:47.352942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:47.479886 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:47.487730 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8f207878-4014-4175-8609-389035e0cd9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.147396 Jul 21 23:10:47.488291 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1450/2756] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:47 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:48.504879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:48.505484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:48.512787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:48.513243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:48.514065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:48.514506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:48.646173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:48.654793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1849bba8-890d-4103-af3b-2768d23e0b34 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.153780 Jul 21 23:10:48.655393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1307/2757] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:48 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:49.671827 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:49.672460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:49.678859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:49.679303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:49.680051 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:49.680494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:49.809939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:49.817739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d50b7403-0d17-4989-9784-c026a60f3eeb tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.149784 Jul 21 23:10:49.818296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1451/2758] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:49 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:50.835001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:50.835612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:50.842731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:50.843298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:50.844633 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:50.845145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:50.975589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:50.984451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4e1b6847-96d2-410f-a7d7-ef0d21ed0b82 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.153275 Jul 21 23:10:50.985031 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1308/2759] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:50 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:52.001610 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:52.002243 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:52.008875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:52.009321 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:52.010074 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:52.010515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:52.134793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:52.142755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8fad6545-0b93-4aed-b179-c4bd16135baa tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.145022 Jul 21 23:10:52.143311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1452/2760] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:51 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:53.159954 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:53.160595 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:53.167862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:53.168318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:53.169122 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:53.169565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:53.301308 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:53.310069 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-17e9e58d-6170-4879-8197-b7dc4d9d018e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1723 microversion: 2.1 time: 0.154004 Jul 21 23:10:53.310657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1309/2761] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:53 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:54.327206 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:54.327795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:54.334814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:54.335256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:54.335997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:54.336426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:54.469571 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:54.478154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ce40ed9c-bf1d-40b2-8a4c-985c7aee8ee7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1700 microversion: 2.1 time: 0.154418 Jul 21 23:10:54.478736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1453/2762] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:54 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:54.495273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a92c01a2-b928-4f0f-a0a3-f36a90e19ba2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:10:54.501756 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a92c01a2-b928-4f0f-a0a3-f36a90e19ba2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:54.502209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a92c01a2-b928-4f0f-a0a3-f36a90e19ba2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:54.524071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a92c01a2-b928-4f0f-a0a3-f36a90e19ba2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Going to try to start instance {{(pid=124534) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 23:10:54.564025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a92c01a2-b928-4f0f-a0a3-f36a90e19ba2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action" status: 202 len: 0 microversion: 2.1 time: 0.073342 Jul 21 23:10:54.564652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1310/2763] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:10:54 2022] POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:10:54.573270 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:54.573880 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:54.579867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:54.580378 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:54.581333 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:54.581848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:54.709600 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:54.718203 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d9abafb1-4cb8-4206-9cba-dea842b6751c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1709 microversion: 2.1 time: 0.149361 Jul 21 23:10:54.718774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1454/2764] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:54 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:55.735709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:55.736331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:55.744073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:55.744653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:55.745428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:55.745901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:55.878387 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:55.886346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5bac3fd8-fc05-4ced-8b4d-ed6e6d1bbada tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1709 microversion: 2.1 time: 0.154909 Jul 21 23:10:55.886909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1311/2765] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:55 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1709 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:10:56.903123 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:10:56.903842 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:10:56.910373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:56.910816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:56.911564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:10:56.911989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:10:57.038940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:10:57.047467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d5309eaa-9dc1-43fd-80eb-fd421556c9ac tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1713 microversion: 2.1 time: 0.148310 Jul 21 23:10:57.048022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1455/2766] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:10:56 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1713 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:30.069578 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:30.070199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:30.073139 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=20 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:11:30.073915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:11:30.080385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:30.080877 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:30.081657 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:30.082101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:30.161568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lazy-loading 'services' on Instance uuid dcd1b861-8e14-4d14-91b5-b500a09df984 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:11:30.232885 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-67912fe3-0fec-42bd-afcb-a1e2598c92b2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments/5958b594-8677-40a8-897c-a4460ab2a82d" status: 202 len: 0 microversion: 2.1 time: 0.167558 Jul 21 23:11:30.233471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1312/2767] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:11:30 2022] DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments/5958b594-8677-40a8-897c-a4460ab2a82d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:11:31.343127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d6e8a8f4-282b-45f1-a626-1d107771da9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:11:31.345388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=22 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:11:31.346276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:11:31.352092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8f4-282b-45f1-a626-1d107771da9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:31.352641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d6e8a8f4-282b-45f1-a626-1d107771da9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:31.414736 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d6e8a8f4-282b-45f1-a626-1d107771da9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Going to try to stop instance {{(pid=124535) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 23:11:31.462425 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d6e8a8f4-282b-45f1-a626-1d107771da9c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action" status: 202 len: 0 microversion: 2.1 time: 0.123174 Jul 21 23:11:31.463110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1456/2768] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:11:31 2022] POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:11:31.471853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:31.472586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:31.481377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:31.482307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:31.483093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:31.483533 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:31.617966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:31.626608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-35a0bf7d-dbfc-4eed-9c04-44da2a45514d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.158985 Jul 21 23:11:31.627160 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1313/2769] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:31 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:11:32.644381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:32.645106 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:32.652328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:32.652804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:32.653560 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:32.653996 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:32.783646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:32.791245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-795d7f2b-5561-4fff-8936-29f9593d6a60 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.151481 Jul 21 23:11:32.791802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1457/2770] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:32 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:33.808224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:33.808854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:33.815261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:33.815708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:33.816459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:33.816914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:33.949458 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:33.956905 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-8a8e5544-d410-4209-9efb-da8f3c8b1453 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.152667 Jul 21 23:11:33.957457 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1314/2771] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:33 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:34.974667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:34.975276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:34.982528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:34.982976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:34.983733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:34.984166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:35.108436 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:35.115814 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-518fd29c-2a3a-4fd0-b201-dec4374d311d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.145014 Jul 21 23:11:35.116367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1458/2772] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:34 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:36.132305 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:36.132949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:36.139936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:36.140384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:36.141173 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:36.141610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:36.270349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:36.278793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cf84d956-a678-4f58-aacb-16b94f9999af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.150326 Jul 21 23:11:36.279369 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1315/2773] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:36 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:37.296152 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:37.296763 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:37.303168 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:37.303608 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:37.304357 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:37.304808 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:37.438274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:37.445696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-38468280-0904-4471-8c0a-a445a2eda713 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.153455 Jul 21 23:11:37.446239 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1459/2774] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:37 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:11:38.462628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:38.463244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:38.469705 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:38.470153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:38.470911 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:38.471349 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:38.599362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:38.607354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0cda13f0-d0f8-4b89-9dda-5c9e0518ad69 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.148691 Jul 21 23:11:38.607947 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1316/2775] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:38 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:39.625207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:39.625813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:39.632256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:39.632739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:39.633493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:39.634506 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:39.760581 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:39.768043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-245dc42a-4467-4c47-95b9-07e8fc8a34e7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.146663 Jul 21 23:11:39.768650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1460/2776] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:39 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:40.790616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:40.791231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:40.797969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:40.798428 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:40.799186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:40.799626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:40.930384 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:40.939038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-14efdfab-6d76-48dc-886c-01138c739502 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1677 microversion: 2.1 time: 0.152921 Jul 21 23:11:40.939596 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1317/2777] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:40 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:41.955885 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:41.956517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:41.963253 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:41.963698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:41.964454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:41.964916 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:42.092617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:42.100065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d50f183e-5d5f-4b3b-8bd7-0cd51aa45e3d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1654 microversion: 2.1 time: 0.148016 Jul 21 23:11:42.100652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1461/2778] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:41 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:42.117283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-25e1514e-004b-4241-8cbd-b84adfe65ab3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:11:42.124420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25e1514e-004b-4241-8cbd-b84adfe65ab3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:42.125041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25e1514e-004b-4241-8cbd-b84adfe65ab3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:42.146669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-25e1514e-004b-4241-8cbd-b84adfe65ab3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Going to try to start instance {{(pid=124534) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 23:11:42.189332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-25e1514e-004b-4241-8cbd-b84adfe65ab3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action" status: 202 len: 0 microversion: 2.1 time: 0.075969 Jul 21 23:11:42.189958 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1318/2779] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:11:42 2022] POST /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:11:42.198417 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:42.199031 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:42.205328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:42.205773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:42.206538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:42.206971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:42.337977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:42.345500 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-26687af3-b20b-4db1-ac99-a361587221d3 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1663 microversion: 2.1 time: 0.151421 Jul 21 23:11:42.346273 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1462/2780] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:42 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:43.364056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:43.364822 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:43.371422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:43.371876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:43.372689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:43.373136 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:43.507700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:43.515881 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-728a2288-502a-4f39-902f-fa0e4d10fb8d tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1663 microversion: 2.1 time: 0.156489 Jul 21 23:11:43.516560 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1319/2781] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:43 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:11:44.533067 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:11:44.533709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:11:44.540879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:44.541332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:44.542089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:11:44.542530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:11:44.819382 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:11:44.827343 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a6bc5e00-99a1-4ede-89f6-caefbcc5b804 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1667 microversion: 2.1 time: 0.298096 Jul 21 23:11:44.827896 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1463/2782] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:11:44 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1667 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:17.575431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:17.576409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:17.578692 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=16 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:17.579475 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:17.584815 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.585260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.586038 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.586462 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.618385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aed58cce-c2d6-4b7c-92d2-c1481c87ecb7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046746 Jul 21 23:12:17.618939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1320/2783] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:12:17 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:12:17.675166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:17.675700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:17.677788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=16 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:17.678575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:17.685557 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.685945 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.686702 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.687136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.713325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:12:17.786642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0dcd495c-3509-4242-8142-fd2ad66ee924 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 204 len: 0 microversion: 2.1 time: 0.115273 Jul 21 23:12:17.787214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1464/2784] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:12:17 2022] DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:12:17.795863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:17.796471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:17.802401 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.802854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.803612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:17.804081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:17.988261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:17.996252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-261adfeb-e350-4e63-9581-a1534d2043f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1673 microversion: 2.1 time: 0.204219 Jul 21 23:12:17.996847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1321/2785] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:17 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1673 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:19.014209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:19.014900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:19.022422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:19.022927 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:19.023981 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:19.024413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:19.171100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:19.178551 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7c190e9c-5c7b-4948-aa96-450c0ebaee6c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1673 microversion: 2.1 time: 0.168769 Jul 21 23:12:19.179739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1465/2786] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:19 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:20.196347 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:20.196935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:20.203279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:20.203728 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:20.204498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:20.204945 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:20.416701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:20.424619 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-23d561c0-8cb4-42da-bba8-c240f05b1689 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1673 microversion: 2.1 time: 0.232253 Jul 21 23:12:20.431140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1322/2787] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:20 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1673 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:21.145182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-ee37b3a9-8671-455e-b7e6-1508f68a1ce2 req-a92f08a7-932e-4836-b057-b0792de8ee1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b861-8e14-4d14-91b5-b500a09df984", "name": "network-vif-deleted", "tag": "9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:21.155515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-ee37b3a9-8671-455e-b7e6-1508f68a1ce2 req-a92f08a7-932e-4836-b057-b0792de8ee1d service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:21.155960 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-ee37b3a9-8671-455e-b7e6-1508f68a1ce2 req-a92f08a7-932e-4836-b057-b0792de8ee1d service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:21.170898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-ee37b3a9-8671-455e-b7e6-1508f68a1ce2 req-a92f08a7-932e-4836-b057-b0792de8ee1d service nova] Creating event network-vif-deleted:9c9c0cfa-d1a4-46f2-89ff-a0304a1a49f7 for instance dcd1b861-8e14-4d14-91b5-b500a09df984 on hv-cinder-85069 Jul 21 23:12:21.176235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-ee37b3a9-8671-455e-b7e6-1508f68a1ce2 req-a92f08a7-932e-4836-b057-b0792de8ee1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034493 Jul 21 23:12:21.177219 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1466/2788] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:12:21.442671 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:21.443295 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:21.450862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:21.451256 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:21.452029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:21.452466 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:21.482764 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:21.483210 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:21.483658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lazy-loading 'fault' on Instance uuid dcd1b861-8e14-4d14-91b5-b500a09df984 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:12:21.529970 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:21.537529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-78e2c3db-b146-4d48-8c87-00cd9690ad78 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 200 len: 1327 microversion: 2.1 time: 0.098801 Jul 21 23:12:21.538095 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1323/2789] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:21 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:22.556132 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:22.556857 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:22.563690 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:22.564143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:22.564966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:22.565405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:22.580287 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 HTTP/1.1 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:12:22.581993 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:12:22.583868 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'dcd1b861-8e14-4d14-91b5-b500a09df984'} Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:12:22.584986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:12:22.587721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:12:22.589314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:12:22.589314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-94f9e4e0-a39a-4a70-9943-327ad86f5fda tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 404 len: 111 microversion: 2.1 time: 0.031735 Jul 21 23:12:22.589314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1467/2790] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:22 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:12:22.592957 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-836db4dd-dcbf-4fcb-9f03-596287fa031e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '.version_select at 0x7ff1d8a81310>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:22.612827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-836db4dd-dcbf-4fcb-9f03-596287fa031e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233183350" status: 202 len: 0 microversion: 2.1 time: 0.023525 Jul 21 23:12:22.613366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1324/2791] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233183350 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:12:23.237607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bc13d259-e9f2-493b-9e90-ac21e769e3cd tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: .version_select at 0x7ff1dd1013a0>, body: {"keypair": {"name": "tempest-keypair-1304248204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4EzmYZYRT0Esk/CuwwO+gmF6saVUj7ummE7OEnq2w9XjpxObR0R329N8HS0T4kuY1wtIRbDt5vjI/yn5AskhYh7m8xubW3mdICXc07mHB3++Ruclgrt9U869puBAYYGA=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:23.252336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-bc13d259-e9f2-493b-9e90-ac21e769e3cd tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:12:23.256149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-bc13d259-e9f2-493b-9e90-ac21e769e3cd tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for user 8a7e4fed38914f91beae1c094d73163f and project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:12:23.278906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bc13d259-e9f2-493b-9e90-ac21e769e3cd tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045280 Jul 21 23:12:23.279497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1468/2792] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:12:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:12:23.299893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:12:23.300083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:12:24.763104 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1582323157", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26d482a8-3a9b-4cc3-a551-90512775de63"}], "security_groups": [{"name": "tempest-securitygroup--664067113"}], "key_name": "tempest-keypair-1304248204", "user_data": "}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:24.867506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] validate_networks() for [('26d482a8-3a9b-4cc3-a551-90512775de63', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:12:25.231309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:12:25.231730 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:12:25.232199 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:12:25.232635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:12:25.233042 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:12:25.242569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:25.243007 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:25.243787 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:25.244218 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:25.261076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:12:25.264948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Getting quotas for user 8a7e4fed38914f91beae1c094d73163f and project 37eee429bcbb4cdabc59a2e8a23da997. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:12:25.278345 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:12:25.280622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:12:25.326678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-13f08452-dea2-4828-ab2e-81050282e690 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.568363 Jul 21 23:12:25.327358 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1325/2793] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:12:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 23:12:25.337673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-490cd273-4dfe-40bb-bdb0-090ecdbed47e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:25.338284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-490cd273-4dfe-40bb-bdb0-090ecdbed47e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:25.398318 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-490cd273-4dfe-40bb-bdb0-090ecdbed47e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:25.405229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-490cd273-4dfe-40bb-bdb0-090ecdbed47e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1238 microversion: 2.1 time: 0.071831 Jul 21 23:12:25.405797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1469/2794] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:25 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:26.424244 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:26.424878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:26.438119 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:26.438733 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:26.439624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:26.440165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:26.515682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:26.523876 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0d428266-06ad-43ff-96fd-93159954c289 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1308 microversion: 2.1 time: 0.103288 Jul 21 23:12:26.524498 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1326/2795] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:26 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:27.541509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:27.542280 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:27.548866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:27.549393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:27.550241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:27.550747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:27.678792 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:27.686775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-df6edc9d-1d2a-41d1-abd8-8fff997f0d0f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.149823 Jul 21 23:12:27.687346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1470/2796] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:27 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:27.843418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:12:27.843645 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:12:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:12:27.938329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-8239a642-72b8-4f98-b5e3-89b84dbc7649 req-d30e0bdb-5432-4afd-847a-b7ae9ba178b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68f7875-87f0-492c-9660-5ccdd285c80a", "tag": "cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:27.947732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-8239a642-72b8-4f98-b5e3-89b84dbc7649 req-d30e0bdb-5432-4afd-847a-b7ae9ba178b5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:27.948181 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-8239a642-72b8-4f98-b5e3-89b84dbc7649 req-d30e0bdb-5432-4afd-847a-b7ae9ba178b5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:27.965307 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-8239a642-72b8-4f98-b5e3-89b84dbc7649 req-d30e0bdb-5432-4afd-847a-b7ae9ba178b5 service nova] Creating event network-changed:cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d for instance c68f7875-87f0-492c-9660-5ccdd285c80a on hv-cinder-85069 Jul 21 23:12:27.970309 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-8239a642-72b8-4f98-b5e3-89b84dbc7649 req-d30e0bdb-5432-4afd-847a-b7ae9ba178b5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035651 Jul 21 23:12:27.970868 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1327/2797] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:12:28.703798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:28.704340 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:28.711749 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:28.712200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:28.712991 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:28.713429 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:28.838308 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:28.845656 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9cbb6ba6-7a23-4d7c-b09d-f11c66e9edcf tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.145801 Jul 21 23:12:28.846229 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1471/2798] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:28 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:29.863788 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:29.864500 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:29.871265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:29.871710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:29.872470 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:29.872933 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:30.000398 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:30.007847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7e87c38c-9ab2-4628-bc10-3b9dc27b8f15 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.148746 Jul 21 23:12:30.008409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1328/2799] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:29 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:31.025027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:31.025948 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:31.032109 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:31.032590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:31.033342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:31.033777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:31.164084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:31.171562 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-0a19ed41-296f-4858-a369-4cb1b21ca5fe tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.151086 Jul 21 23:12:31.172256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1472/2800] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:31 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:32.189053 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:32.189669 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:32.196878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:32.197330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:32.198092 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:32.198556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:32.330834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:32.338291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a3fd3179-cb72-4a5e-b381-752b722315f4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.153114 Jul 21 23:12:32.338847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1329/2801] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:32 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:32.686497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-8c56a0e7-83c8-488a-afbf-2fc14fc10205 req-69fb8333-0340-4fc0-b3a1-609c68fca7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68f7875-87f0-492c-9660-5ccdd285c80a", "name": "network-vif-plugged", "status": "completed", "tag": "cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:32.696368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-8c56a0e7-83c8-488a-afbf-2fc14fc10205 req-69fb8333-0340-4fc0-b3a1-609c68fca7bd service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:32.697601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-8c56a0e7-83c8-488a-afbf-2fc14fc10205 req-69fb8333-0340-4fc0-b3a1-609c68fca7bd service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:32.708832 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-8c56a0e7-83c8-488a-afbf-2fc14fc10205 req-69fb8333-0340-4fc0-b3a1-609c68fca7bd service nova] Creating event network-vif-plugged:cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d for instance c68f7875-87f0-492c-9660-5ccdd285c80a on hv-cinder-85069 Jul 21 23:12:32.715042 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-8c56a0e7-83c8-488a-afbf-2fc14fc10205 req-69fb8333-0340-4fc0-b3a1-609c68fca7bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Jul 21 23:12:32.715634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1473/2802] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:12:33.355251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:33.355897 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:33.362274 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:33.362718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:33.363464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:33.363889 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:33.498604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:33.505906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4442546f-d419-4299-8077-195886752654 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.155344 Jul 21 23:12:33.506460 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1330/2803] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:33 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:34.522658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:34.523362 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:34.530254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:34.530705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:34.531488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:34.531918 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:34.670137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:34.677662 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dfbfe0a4-f572-44eb-adbc-9eb20f123cff tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1363 microversion: 2.1 time: 0.159364 Jul 21 23:12:34.678254 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1474/2804] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:34 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:35.694300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:35.694852 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:35.698214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:35.698883 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:35.703000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:35.703447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:35.704197 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:35.704684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:35.831999 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:12:35.840294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-50dd8d5d-1de5-4ea9-acb0-251c7543fe76 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1550 microversion: 2.1 time: 0.149777 Jul 21 23:12:35.840878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1331/2805] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:12:35 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:12:35.856968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:12:35.857480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:12:35.859379 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:12:35.865258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:35.866517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:35.866964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:35.867400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:35.944547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-31334fd4-5fa4-4196-ba53-7a30f6932e66 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091235 Jul 21 23:12:35.945091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1475/2806] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:12:35 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:12:37.086153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-ffc40d52-a377-4c51-9c95-ef6647361fc3 req-67c0e160-606a-47c7-8ae9-4e9fae971db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68f7875-87f0-492c-9660-5ccdd285c80a", "tag": "cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:12:37.094569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ffc40d52-a377-4c51-9c95-ef6647361fc3 req-67c0e160-606a-47c7-8ae9-4e9fae971db3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:12:37.095010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ffc40d52-a377-4c51-9c95-ef6647361fc3 req-67c0e160-606a-47c7-8ae9-4e9fae971db3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:12:37.106445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-ffc40d52-a377-4c51-9c95-ef6647361fc3 req-67c0e160-606a-47c7-8ae9-4e9fae971db3 service nova] Creating event network-changed:cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d for instance c68f7875-87f0-492c-9660-5ccdd285c80a on hv-cinder-85069 Jul 21 23:12:37.111702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-ffc40d52-a377-4c51-9c95-ef6647361fc3 req-67c0e160-606a-47c7-8ae9-4e9fae971db3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029153 Jul 21 23:12:37.112700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1332/2807] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:12.909380 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:12.910176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:12.914573 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:12.915063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:12.922497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:12.922940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:12.923693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:12.924128 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:12.948706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f6c7450f-5d7e-40cc-a6d2-c261f2a07507 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/ips" status: 200 len: 147 microversion: 2.1 time: 0.040618 Jul 21 23:13:12.949258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1476/2808] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:13:12 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:14.256825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:14.257567 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=62 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:14.261731 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66a09500-6ae5-49d8-9049-55988eb11923"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:14.262875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:14.270238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:14.270687 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:14.272071 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:14.272529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:14.538886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1adc7912-ace3-43be-8507-0bc107734455 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283487 Jul 21 23:13:14.539483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1333/2809] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:13:14 2022] POST /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:22.029787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:22.030709 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:22.037020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:22.037464 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:22.038213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:22.038642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:22.067170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5ecd6d07-c16d-419e-bf70-cdf62967fcd7 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041253 Jul 21 23:13:22.068527 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1477/2810] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:13:22 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:22.079247 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:22.079780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:22.087288 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:22.087737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:22.088521 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:22.088963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:22.117535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-03f02418-8bc7-4a8b-bbcc-468cb2e67b8a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923" status: 200 len: 194 microversion: 2.1 time: 0.043103 Jul 21 23:13:22.118140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1334/2811] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 23:13:22 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:23.475507 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdcaca3a-4127-4ff1-bca2-d735f4297f0a"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:23.476582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:23.483071 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:23.483515 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:23.484260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:23.484729 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:23.754032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1464a829-2bf9-4a7a-9dbd-45952626a5b4 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "POST /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282760 Jul 21 23:13:23.759320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1478/2812] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:13:23 2022] POST /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:31.241817 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:31.242802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:31.249490 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.249943 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.250703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.251137 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.280754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bc0f346c-11c7-4f06-ace7-8259b0165e27 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043627 Jul 21 23:13:31.281304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1335/2813] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:13:31 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:31.451617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:31.452195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:31.458902 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.459338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.460078 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.460563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.488454 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c993a6be-f351-4da5-9d3b-3d53b3ff06af tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923" status: 200 len: 194 microversion: 2.1 time: 0.041600 Jul 21 23:13:31.489039 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1479/2814] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 23:13:31 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:31.498828 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:31.499332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:31.505952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.506408 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.507177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:31.507621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:31.588083 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lazy-loading 'services' on Instance uuid c68f7875-87f0-492c-9660-5ccdd285c80a {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:13:31.669061 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4e2b7255-a51a-4aa5-8d86-d2cdd16233f6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923" status: 202 len: 0 microversion: 2.1 time: 0.173912 Jul 21 23:13:31.669638 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1336/2815] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:13:31 2022] DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/66a09500-6ae5-49d8-9049-55988eb11923 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:13:33.830375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:33.830779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:33.837949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:33.838403 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:33.839164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:33.839604 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:33.867473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1bb7457c-afbb-410a-bcef-583428c6462c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/bdcaca3a-4127-4ff1-bca2-d735f4297f0a" status: 200 len: 194 microversion: 2.1 time: 0.041225 Jul 21 23:13:33.868033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1480/2816] 10.222.0.42 () {58 vars in 1412 bytes} [Thu Jul 21 23:13:33 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/bdcaca3a-4127-4ff1-bca2-d735f4297f0a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:33.878653 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:33.879235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:33.886135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:33.886579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:33.887328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:33.887759 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:33.967467 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lazy-loading 'services' on Instance uuid c68f7875-87f0-492c-9660-5ccdd285c80a {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:13:34.037859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ad8d46f4-edb8-4bac-8d7b-e9c1f67433a2 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/bdcaca3a-4127-4ff1-bca2-d735f4297f0a" status: 202 len: 0 microversion: 2.1 time: 0.163573 Jul 21 23:13:34.038413 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1337/2817] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:13:33 2022] DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments/bdcaca3a-4127-4ff1-bca2-d735f4297f0a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:13:35.192302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:35.193904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:35.200262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.200737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.201487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.201915 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.229558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-37ea9b4a-4748-4d0f-9d1a-0ad6c1864ea8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041157 Jul 21 23:13:35.230095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1481/2818] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:13:35 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:13:35.334386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:35.335427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:35.342283 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.342732 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.343484 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.343915 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.372902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4bb848ec-a50f-416d-9bcd-27fcf1498106 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043008 Jul 21 23:13:35.373377 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1338/2819] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:13:35 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:13:35.429936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:35.430433 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:35.436499 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.436971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.437739 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.438176 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.464184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:13:35.538367 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e1f173ee-59c1-4a93-a410-e62da4586850 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 204 len: 0 microversion: 2.1 time: 0.112617 Jul 21 23:13:35.538949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1482/2820] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:13:35 2022] DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:13:35.548084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:35.548833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:35.555875 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.556324 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.557110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:35.557547 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:35.690262 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:35.698157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2589b14a-d8f3-4ddd-9291-fd523b70bab9 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1675 microversion: 2.1 time: 0.154802 Jul 21 23:13:35.698710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1339/2821] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:35 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:36.716439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:36.717091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:36.723726 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:36.724816 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:36.725611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:36.726045 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:36.856835 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:36.864182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fa6820c8-b663-49b4-b96b-cc27715be39a tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1675 microversion: 2.1 time: 0.152106 Jul 21 23:13:36.865703 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1483/2822] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:36 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:37.882132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:37.882754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:37.889255 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:37.889715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:37.890489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:37.890928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:38.135273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:38.142734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9ae626ff-3ea6-416a-874e-1ebc6e0d30a5 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1675 microversion: 2.1 time: 0.264591 Jul 21 23:13:38.143298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1340/2823] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:37 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:38.601673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-f37a3fd9-ab84-4e21-a78a-44f906094fc3 req-7784fe12-f616-4c65-a4cc-6704c2e03123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68f7875-87f0-492c-9660-5ccdd285c80a", "name": "network-vif-deleted", "tag": "cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:38.611460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-f37a3fd9-ab84-4e21-a78a-44f906094fc3 req-7784fe12-f616-4c65-a4cc-6704c2e03123 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:38.611907 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-f37a3fd9-ab84-4e21-a78a-44f906094fc3 req-7784fe12-f616-4c65-a4cc-6704c2e03123 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:38.625519 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-f37a3fd9-ab84-4e21-a78a-44f906094fc3 req-7784fe12-f616-4c65-a4cc-6704c2e03123 service nova] Creating event network-vif-deleted:cd05aee8-7b5f-4e24-ab29-8b9e32c74a4d for instance c68f7875-87f0-492c-9660-5ccdd285c80a on hv-cinder-85069 Jul 21 23:13:38.630701 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-f37a3fd9-ab84-4e21-a78a-44f906094fc3 req-7784fe12-f616-4c65-a4cc-6704c2e03123 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Jul 21 23:13:38.631447 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1484/2824] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:39.160219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:39.160839 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:39.168757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:39.169209 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:39.170175 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:39.170793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:39.206186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:39.206580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:39.207166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lazy-loading 'fault' on Instance uuid c68f7875-87f0-492c-9660-5ccdd285c80a {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:13:39.255504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7e4fed38914f91beae1c094d73163f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37eee429bcbb4cdabc59a2e8a23da997', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:39.262503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1d0180bd-0784-4403-8e9b-d2a2bbbe759c tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 200 len: 1328 microversion: 2.1 time: 0.106234 Jul 21 23:13:39.263103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1341/2825] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:39 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:13:40.280621 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:40.281314 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:40.288179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:40.288737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:40.289511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:40.289940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:40.302865 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a HTTP/1.1 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:13:40.304456 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:40.306294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'c68f7875-87f0-492c-9660-5ccdd285c80a'} Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:13:40.307392 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:40.309194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:40.310745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:13:40.310745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c4078d88-bfc5-48b2-9df5-0f98b9edeff8 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 404 len: 111 microversion: 2.1 time: 0.029916 Jul 21 23:13:40.310745 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1485/2826] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:40 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:13:40.314610 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc562c4c-28a0-4b15-9f25-92e382c8cf4f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '.version_select at 0x7ff1dd176550>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:40.332850 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc562c4c-28a0-4b15-9f25-92e382c8cf4f tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304248204" status: 202 len: 0 microversion: 2.1 time: 0.021946 Jul 21 23:13:40.333979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1342/2827] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 23:13:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304248204 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:13:43.194511 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:43.195005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:43.197473 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:43.203601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:43.204049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:43.204859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:43.205297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:43.210825 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:43.220933 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a HTTP/1.1 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:13:43.222589 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.225064 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'c68f7875-87f0-492c-9660-5ccdd285c80a'} Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:13:43.225919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.227313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.228747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:13:43.228747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-172892a2-016b-4f60-b891-15415653f440 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 404 len: 111 microversion: 2.1 time: 0.033462 Jul 21 23:13:43.228747 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1486/2828] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:13:43 2022] DELETE /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:13:43.233463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:43.234079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: c68f7875-87f0-492c-9660-5ccdd285c80a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:43.241928 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:43.242378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:43.243146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:43.243586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:43.256987 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a HTTP/1.1 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:13:43.258621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.260396 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'c68f7875-87f0-492c-9660-5ccdd285c80a'} Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:13:43.261666 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. Jul 21 23:13:43.263329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:43.264845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance c68f7875-87f0-492c-9660-5ccdd285c80a could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:13:43.264845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-084ba1b9-29db-40aa-bc2b-c06aac47f50e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a" status: 404 len: 111 microversion: 2.1 time: 0.030352 Jul 21 23:13:43.264845 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1343/2829] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:43 2022] GET /compute/v2.1/servers/c68f7875-87f0-492c-9660-5ccdd285c80a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:13:44.393657 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:44.394151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:44.402813 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:44.403258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:44.404012 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:44.404443 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:44.418002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 HTTP/1.1 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:13:44.419546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.421342 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'dcd1b861-8e14-4d14-91b5-b500a09df984'} Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:13:44.422502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.424344 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.426202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:13:44.426202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7fec5663-873f-4a4d-af4d-da06f283abd6 tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 404 len: 111 microversion: 2.1 time: 0.031112 Jul 21 23:13:44.426202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1487/2830] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:13:44 2022] DELETE /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:13:44.429330 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:44.429956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] [instance: dcd1b861-8e14-4d14-91b5-b500a09df984] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:44.432366 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:44.437950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:44.438397 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:44.439156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:44.439585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:44.445393 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:44.458735 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] HTTP exception thrown: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Request method failure captured: Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 HTTP/1.1 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2dysmhVXbd1RerqQzkM1yQc0fhNhe-Ybg-vEFjQ_xfIDNxBP3T-kndu9pBmWLPQ_Ss0pgmtUCgaVaE-Amil-us3Hanl83cGK5AXA8lW302Tq-BAcxGcnZLIW54lFGa7LwMYzeoxTOwZQXRlqMdQTr_xj3hiVynK4Q-TsNUnZ-HwqMKg Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:13:44.460777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37eee429bcbb4cdabc59a2e8a23da997"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: 37eee429bcbb4cdabc59a2e8a23da997 Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeTestJSON-376252278 Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 8a7e4fed38914f91beae1c094d73163f Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeTestJSON-376252278-project Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.462583 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'dcd1b861-8e14-4d14-91b5-b500a09df984'} Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:13:44.463682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. Jul 21 23:13:44.465373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:13:44.466865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] Returning 404 to user: Instance dcd1b861-8e14-4d14-91b5-b500a09df984 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:13:44.466865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c9c43b8e-0234-4fc1-bdac-41ef9a93d91e tempest-AttachVolumeTestJSON-376252278 tempest-AttachVolumeTestJSON-376252278-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984" status: 404 len: 111 microversion: 2.1 time: 0.036747 Jul 21 23:13:44.466865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1344/2831] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:44 2022] GET /compute/v2.1/servers/dcd1b861-8e14-4d14-91b5-b500a09df984 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 23:13:52.877117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fbc07b05-d36a-4b14-916b-f500191332ce tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: .version_select at 0x7ff1d8b63280>, body: {"keypair": {"name": "tempest-keypair-213969976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTCc9c9oua+XNBODeWcDrL0grP00THc0QCr/YnYQu8/Mg8YQQxy8LY+bOYhcp8kf45UywT78ixvyqVgC5k3CLGhRF6pPnfVVh+wsjLcKcJgYf9gIceP4s2xcaDrUFRpkQ=="}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:52.892035 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-fbc07b05-d36a-4b14-916b-f500191332ce tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:13:52.896830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-fbc07b05-d36a-4b14-916b-f500191332ce tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:13:52.920235 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fbc07b05-d36a-4b14-916b-f500191332ce tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.185669 Jul 21 23:13:52.920860 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1488/2832] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:13:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:13:54.223132 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-27920049", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd"}], "security_groups": [{"name": "tempest-securitygroup--574238422"}], "key_name": "tempest-keypair-213969976", "user_data": "}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:54.329966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.network.neutron [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] validate_networks() for [('9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd', None, None, None, None, None)] {{(pid=124534) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:13:54.713590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:13:54.714101 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image limits 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:13:54.714586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:13:54.715000 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image pref 0:0:0 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:13:54.715416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.virt.hardware [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124534) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:13:54.724990 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:54.725442 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:54.726246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:54.726924 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:54.745094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:13:54.749154 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:13:54.761183 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Going to run 1 instances... {{(pid=124534) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:13:54.763503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124534) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:13:54.813298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b2dbc2ce-9bcd-414e-a438-7db67127afcc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594621 Jul 21 23:13:54.813940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1345/2833] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:13:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:13:54.824869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-bd4a1f79-85de-4945-a42c-15a32de0661b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:54.825528 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-bd4a1f79-85de-4945-a42c-15a32de0661b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:54.831625 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:13:54.898837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-bd4a1f79-85de-4945-a42c-15a32de0661b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:54.905710 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-bd4a1f79-85de-4945-a42c-15a32de0661b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1239 microversion: 2.1 time: 0.085153 Jul 21 23:13:54.906325 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1489/2834] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:54 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:55.926834 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:55.927594 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:55.934746 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:55.935202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:55.935983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:55.936423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:56.023967 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:56.034300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-42df4296-7a7a-4657-a3f4-751ec34f456e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1299 microversion: 2.1 time: 0.113873 Jul 21 23:13:56.035276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1346/2835] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:55 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:57.052977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:57.053683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:57.060891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:57.061428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:57.062263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:57.062774 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:57.196358 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:57.203998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-eebe0df5-1728-458c-8b5c-8cdf4b42f223 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.155068 Jul 21 23:13:57.204721 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1490/2836] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:57 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:57.568760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-b4c80f99-1dc9-41a6-8806-2467c9a1d48a req-4673dea6-2b90-428b-86f1-2ca8a0503ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e990a-7b8d-4c84-bdc7-d7c69421915a", "tag": "bd9b5c41-723a-4585-8fd3-3606040c57f7"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:13:57.578980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b4c80f99-1dc9-41a6-8806-2467c9a1d48a req-4673dea6-2b90-428b-86f1-2ca8a0503ac5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:57.579645 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b4c80f99-1dc9-41a6-8806-2467c9a1d48a req-4673dea6-2b90-428b-86f1-2ca8a0503ac5 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:57.592981 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-b4c80f99-1dc9-41a6-8806-2467c9a1d48a req-4673dea6-2b90-428b-86f1-2ca8a0503ac5 service nova] Creating event network-changed:bd9b5c41-723a-4585-8fd3-3606040c57f7 for instance e97e990a-7b8d-4c84-bdc7-d7c69421915a on hv-cinder-85069 Jul 21 23:13:57.598913 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-b4c80f99-1dc9-41a6-8806-2467c9a1d48a req-4673dea6-2b90-428b-86f1-2ca8a0503ac5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033304 Jul 21 23:13:57.599648 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1347/2837] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:13:58.221460 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:58.222069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:58.229276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:58.229718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:58.230461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:58.230889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:58.580083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:58.588237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ee353928-3426-4309-8662-37df62d30c07 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.370588 Jul 21 23:13:58.588891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1491/2838] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:58 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:13:59.606074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:13:59.606775 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:13:59.612977 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:59.614328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:59.615400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:13:59.615833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:13:59.742749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:13:59.750165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6cb4fc9a-208d-4700-9c38-3da4433598e7 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.148868 Jul 21 23:13:59.750723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1348/2839] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:13:59 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:00.767028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:00.767579 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:00.774822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:00.775296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:00.776050 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:00.776498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:00.908122 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:00.916017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fe6c23db-6877-4810-aaf4-01a55296a822 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.152908 Jul 21 23:14:00.916590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1492/2840] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:00 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:01.932824 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:01.933432 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:01.939878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:01.940323 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:01.941111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:01.942355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:02.072346 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:02.079825 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-20ddccbc-99f9-4dd8-a494-42d16320c939 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.150857 Jul 21 23:14:02.080389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1349/2841] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:01 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:03.096889 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:03.097537 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:03.104101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:03.104706 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:03.105480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:03.105919 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:03.107938 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-10338540-ef12-4374-927e-1cd7b64fa7f2 req-92904f9f-d0de-44fc-b248-f4b87baa045c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e990a-7b8d-4c84-bdc7-d7c69421915a", "name": "network-vif-plugged", "status": "completed", "tag": "bd9b5c41-723a-4585-8fd3-3606040c57f7"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:03.119841 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-10338540-ef12-4374-927e-1cd7b64fa7f2 req-92904f9f-d0de-44fc-b248-f4b87baa045c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:03.120286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-10338540-ef12-4374-927e-1cd7b64fa7f2 req-92904f9f-d0de-44fc-b248-f4b87baa045c service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:03.134120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-10338540-ef12-4374-927e-1cd7b64fa7f2 req-92904f9f-d0de-44fc-b248-f4b87baa045c service nova] Creating event network-vif-plugged:bd9b5c41-723a-4585-8fd3-3606040c57f7 for instance e97e990a-7b8d-4c84-bdc7-d7c69421915a on hv-cinder-85069 Jul 21 23:14:03.139781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-10338540-ef12-4374-927e-1cd7b64fa7f2 req-92904f9f-d0de-44fc-b248-f4b87baa045c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035543 Jul 21 23:14:03.140630 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1350/2842] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:14:03.244256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:03.251826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ff092dec-63b3-4c61-83a2-0013345b337a tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.158933 Jul 21 23:14:03.252389 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1493/2843] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:03 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:04.271797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:04.272504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:04.279088 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:04.279532 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:04.280280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:04.280742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:04.414581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:04.422047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-847333ff-c43a-4aa4-915d-0fb5cecc5187 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1364 microversion: 2.1 time: 0.154956 Jul 21 23:14:04.422611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1351/2844] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:04 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:05.438683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:05.439294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:05.442850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:05.448539 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:05.448987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:05.449743 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:05.450174 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:05.577746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:05.585214 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-dfad3983-0b1b-4aac-9450-d3aa125a9952 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1552 microversion: 2.1 time: 0.150389 Jul 21 23:14:05.585761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1494/2845] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:05 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:05.601600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:05.602117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:05.604010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:05.604752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:05.611253 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:05.611704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:05.612464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:05.612930 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:05.692252 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00050930-d2aa-440d-ae33-3725a147a3f2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094182 Jul 21 23:14:05.693020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1352/2846] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:14:05 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:06.866838 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-7c4276b2-d088-48bf-8f41-81d307a27f25 req-d44de668-0e21-42db-87e2-0a5fb75c9b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e97e990a-7b8d-4c84-bdc7-d7c69421915a", "tag": "bd9b5c41-723a-4585-8fd3-3606040c57f7"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:06.875241 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-7c4276b2-d088-48bf-8f41-81d307a27f25 req-d44de668-0e21-42db-87e2-0a5fb75c9b5b service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:06.875676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-7c4276b2-d088-48bf-8f41-81d307a27f25 req-d44de668-0e21-42db-87e2-0a5fb75c9b5b service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:06.887307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-7c4276b2-d088-48bf-8f41-81d307a27f25 req-d44de668-0e21-42db-87e2-0a5fb75c9b5b service nova] Creating event network-changed:bd9b5c41-723a-4585-8fd3-3606040c57f7 for instance e97e990a-7b8d-4c84-bdc7-d7c69421915a on hv-cinder-85069 Jul 21 23:14:06.892468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-7c4276b2-d088-48bf-8f41-81d307a27f25 req-d44de668-0e21-42db-87e2-0a5fb75c9b5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030098 Jul 21 23:14:06.893276 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1495/2847] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:42.724929 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:42.725860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=35 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:42.729649 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:42.730140 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:42.737503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:42.737956 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:42.738969 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:42.739407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:42.762041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1ce29380-d320-404c-a24b-3ed1d9034969 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/ips" status: 200 len: 148 microversion: 2.1 time: 0.038587 Jul 21 23:14:42.762600 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1353/2848] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:14:42 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:44.108218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f7cde3-61ac-458d-b825-3a535cdecdd2"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:44.109415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:44.111489 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:44.112126 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=32 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:44.118601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:44.119095 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:44.119798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:44.120426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:44.373336 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-454447f3-d59d-41e3-bf9e-1e67084baf30 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269271 Jul 21 23:14:44.373904 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1496/2849] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:14:44 2022] POST /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:51.860641 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-28a23f5f-a271-4726-9cec-eda5346dae3c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: .version_select at 0x7ff1dd1761f0>, body: {"keypair": {"name": "tempest-keypair-2114567210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2W41PiAsEEzI1cY0JJvy89OD35+BV26HHL9eWzklaVE+3pEB/IdxvyCrTyeqeUkiK4aKzAJ7P15K8ewLvLf77TSY5CeanaBEoQJh9A0D/RtdzkXlP71TOxTnWsWUvUpA=="}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:51.874860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-28a23f5f-a271-4726-9cec-eda5346dae3c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:14:51.878558 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-28a23f5f-a271-4726-9cec-eda5346dae3c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:14:51.901117 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-28a23f5f-a271-4726-9cec-eda5346dae3c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044485 Jul 21 23:14:51.901702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1354/2850] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:14:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:53.119373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1679764202", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd"}], "security_groups": [{"name": "tempest-securitygroup--493134034"}], "key_name": "tempest-keypair-2114567210", "user_data": "}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:53.218193 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] validate_networks() for [('9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:14:53.654618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:14:53.655154 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:14:53.655766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:14:53.656209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:14:53.656652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:14:53.666166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:53.666611 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:53.667399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:53.667834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:53.684055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:14:53.687994 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:14:53.699246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:14:53.701633 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:14:53.749592 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-838ac405-bf7e-4a2d-9ae3-4f0070cb2ead tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635861 Jul 21 23:14:53.750487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1497/2851] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:14:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:14:53.757157 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=4 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:14:53.761773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a4f1bbf9-28dd-453b-ba07-6d8d2ee9fe99 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:53.762392 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a4f1bbf9-28dd-453b-ba07-6d8d2ee9fe99 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:53.820206 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a4f1bbf9-28dd-453b-ba07-6d8d2ee9fe99 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:53.827561 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a4f1bbf9-28dd-453b-ba07-6d8d2ee9fe99 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1242 microversion: 2.1 time: 0.071361 Jul 21 23:14:53.828113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1355/2852] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:53 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:54.844647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:54.845278 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:54.853613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:54.854065 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:54.854828 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:54.855262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:54.923836 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:54.932297 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7a345d7b-1b89-4a40-8f31-cccaf4156904 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1302 microversion: 2.1 time: 0.092132 Jul 21 23:14:54.932921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1498/2853] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:54 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:55.950054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:55.950942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:55.959686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:55.960153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:55.961162 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:55.961678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:56.186914 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:56.195030 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c5e27ac4-75c9-49ee-bd0f-ee217c612652 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.248786 Jul 21 23:14:56.195506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1356/2854] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:55 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:56.556158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-08128bb0-dea2-4997-9402-016ddb22fdc8 req-1b355a1c-861b-4e4a-9442-b11e1069f6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ab196d-4974-4f08-8ee9-d568cd6d6c6b", "tag": "9c432918-00d5-4d18-a807-20fd8a40549c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:14:56.564844 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-08128bb0-dea2-4997-9402-016ddb22fdc8 req-1b355a1c-861b-4e4a-9442-b11e1069f6e0 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:56.565294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-08128bb0-dea2-4997-9402-016ddb22fdc8 req-1b355a1c-861b-4e4a-9442-b11e1069f6e0 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:56.577587 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-08128bb0-dea2-4997-9402-016ddb22fdc8 req-1b355a1c-861b-4e4a-9442-b11e1069f6e0 service nova] Creating event network-changed:9c432918-00d5-4d18-a807-20fd8a40549c for instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b on hv-cinder-85069 Jul 21 23:14:56.582643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-08128bb0-dea2-4997-9402-016ddb22fdc8 req-1b355a1c-861b-4e4a-9442-b11e1069f6e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106963 Jul 21 23:14:56.583245 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1499/2855] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:14:57.212138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:57.212833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:57.219201 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:57.219646 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:57.220399 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:57.220859 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:57.351443 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:57.358884 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9e63c536-4206-4543-9368-c8187d4dd167 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.150748 Jul 21 23:14:57.359454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1357/2856] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:57 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:58.377508 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:58.378200 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:58.386345 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:58.386783 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:58.387542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:58.387971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:58.521976 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:58.529304 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-deb0fc80-a03b-4fce-8446-6faa46c01010 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.156015 Jul 21 23:14:58.529859 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1500/2857] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:58 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:14:59.546186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:14:59.546796 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:14:59.553984 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:59.554435 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:59.555290 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:14:59.555793 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:14:59.688616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:14:59.696281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-86da7bb5-2f36-4c1c-bd51-a7e85db76355 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.153917 Jul 21 23:14:59.696882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1358/2858] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:14:59 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:00.713575 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:00.714111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:00.720452 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:00.720906 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:00.721678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:00.722107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:00.851207 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:00.858491 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8d7e4882-1cc3-4b90-90cf-52db887ad586 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.149329 Jul 21 23:15:00.859046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1501/2859] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:00 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:01.361723 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-d1cff9b9-33f1-48d6-b4fa-9cfa07d62dea req-ee896d0d-b16d-419b-bebc-985450a370e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ab196d-4974-4f08-8ee9-d568cd6d6c6b", "name": "network-vif-plugged", "status": "completed", "tag": "9c432918-00d5-4d18-a807-20fd8a40549c"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:01.370863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d1cff9b9-33f1-48d6-b4fa-9cfa07d62dea req-ee896d0d-b16d-419b-bebc-985450a370e3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:01.371304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-d1cff9b9-33f1-48d6-b4fa-9cfa07d62dea req-ee896d0d-b16d-419b-bebc-985450a370e3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:01.382446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-d1cff9b9-33f1-48d6-b4fa-9cfa07d62dea req-ee896d0d-b16d-419b-bebc-985450a370e3 service nova] Creating event network-vif-plugged:9c432918-00d5-4d18-a807-20fd8a40549c for instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b on hv-cinder-85069 Jul 21 23:15:01.387406 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-d1cff9b9-33f1-48d6-b4fa-9cfa07d62dea req-ee896d0d-b16d-419b-bebc-985450a370e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091101 Jul 21 23:15:01.387986 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1359/2860] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:01.875062 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:01.875692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:01.882296 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:01.882822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:01.883475 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:01.883903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:02.014766 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:02.022086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-cc0bd4dc-8114-4e5b-b605-f5e9f01a3abd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.150883 Jul 21 23:15:02.023205 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1502/2861] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:01 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:03.040806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:03.041683 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:03.047950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:03.048375 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:03.049176 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:03.049618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:03.181373 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:03.188864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f5d6002e-b233-4793-a96b-ce0008527ccd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1367 microversion: 2.1 time: 0.153119 Jul 21 23:15:03.189422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1360/2862] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:03 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:04.206124 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:04.206731 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:04.209159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:04.209826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:04.215826 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:04.216262 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:04.217038 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:04.217466 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:04.344113 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:04.351647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8ccf7415-42bc-4658-8b78-92d932b638c4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1556 microversion: 2.1 time: 0.149434 Jul 21 23:15:04.352209 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1503/2863] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:04 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:04.368436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:04.368944 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:04.370935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:04.376710 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:04.377158 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:04.377908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:04.378343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:04.456748 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e406b33d-3f26-45bd-858c-430ef9363df2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092649 Jul 21 23:15:04.457342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1361/2864] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:15:04 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:05.617683 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-79ed639f-4ead-4b9f-a8d1-bf146b005e23 req-8698ce6b-4131-4fe1-bb2c-e0d4088ba258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ab196d-4974-4f08-8ee9-d568cd6d6c6b", "tag": "9c432918-00d5-4d18-a807-20fd8a40549c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:05.626091 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-79ed639f-4ead-4b9f-a8d1-bf146b005e23 req-8698ce6b-4131-4fe1-bb2c-e0d4088ba258 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:05.626530 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-79ed639f-4ead-4b9f-a8d1-bf146b005e23 req-8698ce6b-4131-4fe1-bb2c-e0d4088ba258 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:05.638098 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-79ed639f-4ead-4b9f-a8d1-bf146b005e23 req-8698ce6b-4131-4fe1-bb2c-e0d4088ba258 service nova] Creating event network-changed:9c432918-00d5-4d18-a807-20fd8a40549c for instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b on hv-cinder-85069 Jul 21 23:15:05.643284 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-79ed639f-4ead-4b9f-a8d1-bf146b005e23 req-8698ce6b-4131-4fe1-bb2c-e0d4088ba258 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029734 Jul 21 23:15:05.643964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1504/2865] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:41.412424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:41.413321 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=30 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:41.417423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:41.417923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:41.424966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.425420 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.426180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.426617 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.450545 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-dad5557d-3c6e-4db2-b433-134212ce6865 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/ips" status: 200 len: 148 microversion: 2.1 time: 0.039370 Jul 21 23:15:41.451110 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1362/2866] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:15:41 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:41.459195 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:41.459908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:15:41.465423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2f7cde3-61ac-458d-b825-3a535cdecdd2"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:41.466653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:41.474356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.474908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.475910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.476569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.556672 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: POST /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/os-volume_attachments HTTP/1.1 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 74 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:15:41.558375 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {"volumeAttachment": {"volumeId": "a2f7cde3-61ac-458d-b825-3a535cdecdd2"}} Jul 21 23:15:41.560399 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': '57ab196d-4974-4f08-8ee9-d568cd6d6c6b', 'body': {'volumeAttachment': {'volumeId': 'a2f7cde3-61ac-458d-b825-3a535cdecdd2'}}} Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:41.561455 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:41.562952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 400 to user: Invalid volume: volume a2f7cde3-61ac-458d-b825-3a535cdecdd2 is already attached to instances: e97e990a-7b8d-4c84-bdc7-d7c69421915a {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-050102fc-9456-4b94-85c2-6c99ebc31308 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102175 Jul 21 23:15:41.564900 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1505/2867] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:15:41 2022] POST /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:15:41.568381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:41.569001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:41.576089 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.576581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.577343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.577779 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.602795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:15:41.677939 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7a0e5daf-9e44-4ef4-aa5d-a86f59578b8d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 204 len: 0 microversion: 2.1 time: 0.112965 Jul 21 23:15:41.678681 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1363/2868] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:15:41 2022] DELETE /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:15:41.688153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:41.688797 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:41.694722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.695165 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.696543 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:41.697188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:41.828673 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:41.836110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-96e3808c-aa10-40cd-bb65-bd41826d0707 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1680 microversion: 2.1 time: 0.152851 Jul 21 23:15:41.837208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1506/2869] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:41 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:42.854242 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:42.854940 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:42.861318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:42.862012 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:42.862770 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:42.863202 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:42.995109 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:43.003665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-5af46e4a-274d-40e2-8537-2e2f7d23c452 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1680 microversion: 2.1 time: 0.153628 Jul 21 23:15:43.004229 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1364/2870] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:42 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:44.020650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:44.021931 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:44.028407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:44.028890 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:44.029642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:44.030076 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:44.096714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:44.098340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-673df810-64c8-407b-82b1-279ef47391d0 req-5da1007d-36fc-4805-9b9c-433f014598a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ab196d-4974-4f08-8ee9-d568cd6d6c6b", "name": "network-vif-deleted", "tag": "9c432918-00d5-4d18-a807-20fd8a40549c"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:44.105036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a9e52981-dd23-4477-b19a-383cd203a749 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 200 len: 1613 microversion: 2.1 time: 0.088111 Jul 21 23:15:44.105963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1507/2871] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:44 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:44.109479 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-673df810-64c8-407b-82b1-279ef47391d0 req-5da1007d-36fc-4805-9b9c-433f014598a8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:44.109934 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-673df810-64c8-407b-82b1-279ef47391d0 req-5da1007d-36fc-4805-9b9c-433f014598a8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:44.122569 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-673df810-64c8-407b-82b1-279ef47391d0 req-5da1007d-36fc-4805-9b9c-433f014598a8 service nova] Creating event network-vif-deleted:9c432918-00d5-4d18-a807-20fd8a40549c for instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b on hv-cinder-85069 Jul 21 23:15:44.127917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-673df810-64c8-407b-82b1-279ef47391d0 req-5da1007d-36fc-4805-9b9c-433f014598a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034173 Jul 21 23:15:44.128893 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1365/2872] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:15:45.122908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:45.123517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:45.130395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:45.130870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:45.131631 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:45.132063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:45.148138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b HTTP/1.1 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:15:45.149705 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:15:45.151522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '57ab196d-4974-4f08-8ee9-d568cd6d6c6b'} Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:15:45.152698 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:15:45.154444 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:15:45.156182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:15:45.156182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7b05633f-8637-4cfd-9a5d-669f47ff7f98 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 404 len: 111 microversion: 2.1 time: 0.032184 Jul 21 23:15:45.156182 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1508/2873] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:45 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:15:45.160742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fe35fc36-1fec-46d2-b239-13318035a8dd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '.version_select at 0x7ff1dd260c10>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:45.177949 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fe35fc36-1fec-46d2-b239-13318035a8dd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114567210" status: 202 len: 0 microversion: 2.1 time: 0.021724 Jul 21 23:15:45.178496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1366/2874] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 23:15:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114567210 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 23:15:45.841274 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:45.841760 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:45.847689 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:45.848130 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:45.848903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:45.849334 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:45.929148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lazy-loading 'services' on Instance uuid e97e990a-7b8d-4c84-bdc7-d7c69421915a {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:15:46.000133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-92a5a64d-6848-450e-a442-93bb8588f8c8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments/a2f7cde3-61ac-458d-b825-3a535cdecdd2" status: 202 len: 0 microversion: 2.1 time: 0.162544 Jul 21 23:15:46.000824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1509/2875] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:15:45 2022] DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments/a2f7cde3-61ac-458d-b825-3a535cdecdd2 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:15:46.009790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:46.010922 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:46.017678 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:46.018200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:46.019049 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:46.019548 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:46.057503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a5e9e4f5-6391-402b-97af-469cd42cdb3d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052325 Jul 21 23:15:46.058064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1367/2876] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:15:46 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:47.070083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:47.072105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:47.078609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.079055 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.079829 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.080266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.108424 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-88814109-1287-45d0-aeea-34309450fce5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043100 Jul 21 23:15:47.109028 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1510/2877] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:15:47 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:15:47.170597 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:47.171142 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:47.177628 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.178135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.179121 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.179603 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.205709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Going to try to terminate instance {{(pid=124534) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:15:47.278612 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-40f673f0-f548-4f41-b243-b4dd1c51eb82 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 204 len: 0 microversion: 2.1 time: 0.117445 Jul 21 23:15:47.279189 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1368/2878] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:15:47 2022] DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:15:47.287922 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:47.288555 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:47.295046 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.295492 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.296238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:47.296696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:47.426617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:47.435521 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f6b250ba-8ed8-4f5f-90a3-f454e180b467 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1677 microversion: 2.1 time: 0.151821 Jul 21 23:15:47.436089 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1511/2879] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:47 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:15:48.453234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:48.453932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:48.460318 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:48.460789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:48.462153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:48.462581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:48.599709 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:48.607766 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-49f1f954-7729-4009-801e-3b1649101b26 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1677 microversion: 2.1 time: 0.158857 Jul 21 23:15:48.608325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1369/2880] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:48 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:49.625043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:49.625687 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:49.632234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:49.632718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:49.633578 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:49.634083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:49.765988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:49.773952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ef81a095-2f71-417e-98e0-7f86f9937447 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1677 microversion: 2.1 time: 0.152313 Jul 21 23:15:49.774641 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1512/2881] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:49 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:50.238861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-3edd254c-aa5e-4893-822a-e7119448a231 req-0fe0fc5d-ca46-41d0-bb7a-8814bcc45dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e97e990a-7b8d-4c84-bdc7-d7c69421915a", "name": "network-vif-deleted", "tag": "bd9b5c41-723a-4585-8fd3-3606040c57f7"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:50.250166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-3edd254c-aa5e-4893-822a-e7119448a231 req-0fe0fc5d-ca46-41d0-bb7a-8814bcc45dd6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:50.250742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-3edd254c-aa5e-4893-822a-e7119448a231 req-0fe0fc5d-ca46-41d0-bb7a-8814bcc45dd6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:50.264524 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-3edd254c-aa5e-4893-822a-e7119448a231 req-0fe0fc5d-ca46-41d0-bb7a-8814bcc45dd6 service nova] Creating event network-vif-deleted:bd9b5c41-723a-4585-8fd3-3606040c57f7 for instance e97e990a-7b8d-4c84-bdc7-d7c69421915a on hv-cinder-85069 Jul 21 23:15:50.270261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-3edd254c-aa5e-4893-822a-e7119448a231 req-0fe0fc5d-ca46-41d0-bb7a-8814bcc45dd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Jul 21 23:15:50.271508 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1370/2882] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:50.792138 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:50.793005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:50.799881 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:50.800328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:50.801127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:50.801559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:50.838347 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:50.838939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:50.839468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.objects.instance [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lazy-loading 'fault' on Instance uuid e97e990a-7b8d-4c84-bdc7-d7c69421915a {{(pid=124535) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:15:50.884159 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:50.890879 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-888f103a-6f73-4586-b3a0-56802f7b876d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 200 len: 1329 microversion: 2.1 time: 0.103930 Jul 21 23:15:50.891469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1513/2883] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:50 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:51.911013 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:51.911708 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:51.918749 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:51.919194 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:51.919972 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:51.920400 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:51.933781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a HTTP/1.1 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:15:51.935363 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:15:51.937589 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'e97e990a-7b8d-4c84-bdc7-d7c69421915a'} Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:15:51.938625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:15:51.940344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:15:51.941917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:15:51.941917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-aaef5692-936e-4a4e-9971-4a014b8cc9dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 404 len: 111 microversion: 2.1 time: 0.030749 Jul 21 23:15:51.941917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1371/2884] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:51 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:15:51.946169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac44514d-d33a-4875-8ab0-b9bc0e339d60 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '.version_select at 0x7ff1dd1118b0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:51.963680 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac44514d-d33a-4875-8ab0-b9bc0e339d60 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213969976" status: 202 len: 0 microversion: 2.1 time: 0.021619 Jul 21 23:15:51.964271 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1514/2885] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213969976 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:15:52.587222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fef64f4c-398d-4ae1-84ba-21e5df5b0ca8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: .version_select at 0x7ff1dd19d790>, body: {"keypair": {"name": "tempest-keypair-1453292184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDU0/Mf3hP41o1qYPhuiDX5Yql6hZjd9o7KTdeeMYXRohG6aY87vIabyPhIQP+KW6jA/t2AOgCDsin/RUncKQGlJ6Uy2bWBjTr8Xn//0uNTPHkluAZt1aZHTvJWJCFkyMQ=="}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:52.600918 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-fef64f4c-398d-4ae1-84ba-21e5df5b0ca8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:15:52.605131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-fef64f4c-398d-4ae1-84ba-21e5df5b0ca8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:15:52.626658 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fef64f4c-398d-4ae1-84ba-21e5df5b0ca8 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043815 Jul 21 23:15:52.627238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1372/2886] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:15:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:53.823542 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-374960985", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd"}], "security_groups": [{"name": "tempest-securitygroup--285972913"}], "key_name": "tempest-keypair-1453292184", "user_data": "}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:53.923693 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] validate_networks() for [('9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:15:54.283401 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:15:54.283822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:15:54.284292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:15:54.284732 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:15:54.285145 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:15:54.294381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:54.294824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:54.295614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:54.296059 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:54.313002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:15:54.316912 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:15:54.328793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:15:54.331018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:15:54.376851 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f1c5b9d5-78cc-488d-a858-860d207dddd5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.558169 Jul 21 23:15:54.377494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1515/2887] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:15:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:15:54.388006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-68d742c0-f54f-46ea-a18b-5e8ab6ab7b32 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:54.388755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-68d742c0-f54f-46ea-a18b-5e8ab6ab7b32 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:54.450343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-68d742c0-f54f-46ea-a18b-5e8ab6ab7b32 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:54.457298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-68d742c0-f54f-46ea-a18b-5e8ab6ab7b32 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1241 microversion: 2.1 time: 0.073230 Jul 21 23:15:54.458177 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1373/2888] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:54 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:55.475149 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:55.476400 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:55.482974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:55.483422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:55.484184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:55.484644 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:55.549677 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:55.557986 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-77727727-fe3c-48a1-a89d-6e622813e407 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1311 microversion: 2.1 time: 0.087487 Jul 21 23:15:55.558695 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1516/2889] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:55 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:56.575534 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:56.576169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:56.582549 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:56.582993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:56.583740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:56.584171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:56.808491 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:56.816863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-25d7528d-0a2a-4b86-ba5d-e936f928c30d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.245020 Jul 21 23:15:56.817440 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1374/2890] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:56 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:56.988744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-444f6bbc-e1f0-423d-b3ea-eb1626d63fa9 req-b313ea6d-2e5e-4355-a9e8-43cdac9a1e2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec116155-1520-493b-b297-2ba1189abc3f", "tag": "d2460726-dd8e-4a51-8412-5f08102cfe0c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:15:56.998461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-444f6bbc-e1f0-423d-b3ea-eb1626d63fa9 req-b313ea6d-2e5e-4355-a9e8-43cdac9a1e2a service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:56.998901 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-444f6bbc-e1f0-423d-b3ea-eb1626d63fa9 req-b313ea6d-2e5e-4355-a9e8-43cdac9a1e2a service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:57.023364 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-444f6bbc-e1f0-423d-b3ea-eb1626d63fa9 req-b313ea6d-2e5e-4355-a9e8-43cdac9a1e2a service nova] Creating event network-changed:d2460726-dd8e-4a51-8412-5f08102cfe0c for instance ec116155-1520-493b-b297-2ba1189abc3f on hv-cinder-85069 Jul 21 23:15:57.029614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-444f6bbc-e1f0-423d-b3ea-eb1626d63fa9 req-b313ea6d-2e5e-4355-a9e8-43cdac9a1e2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044697 Jul 21 23:15:57.030612 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1517/2891] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:15:57.833689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:57.834300 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:57.841386 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:57.841833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:57.842588 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:57.843018 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:57.972551 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:57.980161 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-07056053-e434-471e-bcd6-f51ba1f3a3bf tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.150335 Jul 21 23:15:57.980760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1375/2892] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:57 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:15:58.997908 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:15:58.998538 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:15:59.005169 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:59.005614 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:59.006359 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:15:59.006794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:15:59.142467 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:15:59.151196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7e64bb39-c7c4-4137-81ad-9747a0fd667e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.157526 Jul 21 23:15:59.151750 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1518/2893] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:15:58 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:16:00.168682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:00.169331 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:00.175809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:00.176258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:00.177056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:00.177495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:00.307166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:00.314688 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4e8a0e61-688e-4849-a1dd-ae08a2027da2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.149936 Jul 21 23:16:00.315251 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1376/2894] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:00 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:01.331536 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:01.332135 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:01.339328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:01.339777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:01.340556 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:01.340989 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:01.471790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:01.479746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-39f099b7-8505-4cdb-84c7-ab1235754ca6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.152047 Jul 21 23:16:01.480319 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1519/2895] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:01 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:01.611085 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-83d9a8b4-db76-4ce1-b9fb-8c141394c994 req-15c69c65-ec9c-468e-b982-eee5c7009aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec116155-1520-493b-b297-2ba1189abc3f", "name": "network-vif-plugged", "status": "completed", "tag": "d2460726-dd8e-4a51-8412-5f08102cfe0c"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:01.619976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-83d9a8b4-db76-4ce1-b9fb-8c141394c994 req-15c69c65-ec9c-468e-b982-eee5c7009aaa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:01.620424 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-83d9a8b4-db76-4ce1-b9fb-8c141394c994 req-15c69c65-ec9c-468e-b982-eee5c7009aaa service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:01.631585 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-83d9a8b4-db76-4ce1-b9fb-8c141394c994 req-15c69c65-ec9c-468e-b982-eee5c7009aaa service nova] Creating event network-vif-plugged:d2460726-dd8e-4a51-8412-5f08102cfe0c for instance ec116155-1520-493b-b297-2ba1189abc3f on hv-cinder-85069 Jul 21 23:16:01.637105 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-83d9a8b4-db76-4ce1-b9fb-8c141394c994 req-15c69c65-ec9c-468e-b982-eee5c7009aaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029742 Jul 21 23:16:01.637689 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1377/2896] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:02.496786 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:02.497391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:02.503800 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:02.504246 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:02.505034 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:02.505469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:02.630719 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:02.638104 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f0f60f21-d3ca-442e-a5a9-264983b6797e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1366 microversion: 2.1 time: 0.145231 Jul 21 23:16:02.638654 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1520/2897] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:02 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:03.656236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:03.656961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:03.663070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:03.663528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:03.664298 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:03.664993 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:03.794936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:03.802414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4bdf4676-c162-430f-8d51-fb1cb8c76f76 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1554 microversion: 2.1 time: 0.150950 Jul 21 23:16:03.802979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1378/2898] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:03 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:03.819049 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:03.819546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:03.826490 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:03.826937 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:03.827694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:03.828131 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:03.908676 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-790efbcb-0864-4dd2-80ac-993a4c8ca448 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093084 Jul 21 23:16:03.909288 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1521/2899] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:16:03 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:05.042166 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:05.097404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-ded89959-e0b5-489f-b6e6-005c75eab042 req-146b925e-463f-420d-9cd1-1f91147c0dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec116155-1520-493b-b297-2ba1189abc3f", "tag": "d2460726-dd8e-4a51-8412-5f08102cfe0c"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:05.106156 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ded89959-e0b5-489f-b6e6-005c75eab042 req-146b925e-463f-420d-9cd1-1f91147c0dc9 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:05.106605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ded89959-e0b5-489f-b6e6-005c75eab042 req-146b925e-463f-420d-9cd1-1f91147c0dc9 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:05.118054 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-ded89959-e0b5-489f-b6e6-005c75eab042 req-146b925e-463f-420d-9cd1-1f91147c0dc9 service nova] Creating event network-changed:d2460726-dd8e-4a51-8412-5f08102cfe0c for instance ec116155-1520-493b-b297-2ba1189abc3f on hv-cinder-85069 Jul 21 23:16:05.128464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-ded89959-e0b5-489f-b6e6-005c75eab042 req-146b925e-463f-420d-9cd1-1f91147c0dc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085460 Jul 21 23:16:05.128464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1379/2900] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:40.874397 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:40.875158 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:40.876622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:40.877202 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:40.881535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:40.882097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:40.891830 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:40.892310 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:40.893213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:40.893718 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:40.919224 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2f50c2fa-0aeb-4590-bfac-bc3de476b9a3 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/ips" status: 200 len: 147 microversion: 2.1 time: 0.045612 Jul 21 23:16:40.919795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1522/2901] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:16:40 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/ips => generated 147 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:42.226968 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:42.227781 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:16:42.232514 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da017db9-1669-46e8-9693-2de43f5aebc9"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:42.233686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:42.241765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:42.242224 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:42.242983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:42.243422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:42.501404 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d95b36a8-55a3-4040-9fec-73ebb15abda0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275752 Jul 21 23:16:42.502008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1380/2902] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:16:42 2022] POST /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:49.983036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da017db9-1669-46e8-9693-2de43f5aebc9"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:49.984121 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:49.991027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:49.991497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:49.992238 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:49.992700 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:50.187862 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: POST /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments HTTP/1.1 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 74 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:16:50.189597 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {"volumeAttachment": {"volumeId": "da017db9-1669-46e8-9693-2de43f5aebc9"}} Jul 21 23:16:50.191332 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'server_id': 'ec116155-1520-493b-b297-2ba1189abc3f', 'body': {'volumeAttachment': {'volumeId': 'da017db9-1669-46e8-9693-2de43f5aebc9'}}} Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:16:50.192311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:50.194184 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 400 to user: Invalid volume: volume da017db9-1669-46e8-9693-2de43f5aebc9 is already attached to instances: ec116155-1520-493b-b297-2ba1189abc3f {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a169c2f3-d1c1-4f95-bfe9-9650bb7924b0 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.213000 Jul 21 23:16:50.196293 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1523/2903] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:16:49 2022] POST /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments => generated 174 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 23:16:50.252133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:50.252742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:50.258790 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:50.259231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:50.259980 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:50.260437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:50.342890 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lazy-loading 'services' on Instance uuid ec116155-1520-493b-b297-2ba1189abc3f {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:16:50.415447 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-0fd13356-c7ce-4f23-a6bf-41316b33c963 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments/da017db9-1669-46e8-9693-2de43f5aebc9" status: 202 len: 0 microversion: 2.1 time: 0.168174 Jul 21 23:16:50.416048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1381/2904] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:16:50 2022] DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments/da017db9-1669-46e8-9693-2de43f5aebc9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:16:50.425084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:50.426016 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:50.432779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:50.433068 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:50.434790 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:50.434983 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:50.468054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ccfb5cb2-4217-47c9-bb63-3d90ff86fbd4 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047043 Jul 21 23:16:50.468853 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1524/2905] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:16:50 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:51.480226 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:51.481299 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:51.487471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.487919 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.488975 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.489411 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.519379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-58b5f73a-b579-436d-84f0-12e414c9a737 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043852 Jul 21 23:16:51.519948 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1382/2906] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:16:51 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:16:51.577678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:51.578188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:51.584617 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.585144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.585940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.586372 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.611484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:16:51.686549 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-940098fe-38da-4040-89f6-680c74302be1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 204 len: 0 microversion: 2.1 time: 0.112737 Jul 21 23:16:51.687435 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1525/2907] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:16:51 2022] DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:16:51.696047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:51.696702 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:51.702704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.703153 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.703917 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:51.704357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:51.836145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:51.843814 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-caf739d4-1ae6-4f6d-8c14-da2daa388e0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1678 microversion: 2.1 time: 0.151992 Jul 21 23:16:51.844380 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1383/2908] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:51 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:52.861481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:52.862188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:52.868872 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:52.869326 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:52.870084 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:52.870524 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:53.001266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:53.008735 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2928be92-b3e8-44db-8153-dfe90525a5a9 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1678 microversion: 2.1 time: 0.151507 Jul 21 23:16:53.009302 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1526/2909] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:52 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:54.026935 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:54.027663 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:54.034576 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:54.035033 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:54.035801 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:54.036238 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:54.263070 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:54.270872 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-3292ec24-3d42-4777-ae7d-9cb4329d3621 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 200 len: 1678 microversion: 2.1 time: 0.247822 Jul 21 23:16:54.271451 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1384/2910] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:54 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 1678 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:54.532428 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-04707c45-2a04-4924-8e28-974311088479 req-14180caa-e878-4455-8df5-f0a9acb86926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec116155-1520-493b-b297-2ba1189abc3f", "name": "network-vif-deleted", "tag": "d2460726-dd8e-4a51-8412-5f08102cfe0c"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:54.541624 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-04707c45-2a04-4924-8e28-974311088479 req-14180caa-e878-4455-8df5-f0a9acb86926 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:54.542079 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-04707c45-2a04-4924-8e28-974311088479 req-14180caa-e878-4455-8df5-f0a9acb86926 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:54.555590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-04707c45-2a04-4924-8e28-974311088479 req-14180caa-e878-4455-8df5-f0a9acb86926 service nova] Creating event network-vif-deleted:d2460726-dd8e-4a51-8412-5f08102cfe0c for instance ec116155-1520-493b-b297-2ba1189abc3f on hv-cinder-85069 Jul 21 23:16:54.561716 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-04707c45-2a04-4924-8e28-974311088479 req-14180caa-e878-4455-8df5-f0a9acb86926 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034102 Jul 21 23:16:54.565338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1527/2911] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:55.288819 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:55.289434 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:55.296152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:55.296718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:55.297570 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:55.298078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:55.312700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f HTTP/1.1 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:16:55.314334 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:16:55.315942 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'ec116155-1520-493b-b297-2ba1189abc3f'} Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:16:55.316896 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:16:55.318665 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:16:55.320217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:16:55.320217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-57cf19c6-8a67-4833-9da6-1a40d19d0e18 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 404 len: 111 microversion: 2.1 time: 0.031085 Jul 21 23:16:55.320217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1385/2912] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:55 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:16:55.326852 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc9232c0-e636-4be7-b7b5-ad68d4c4a5fb tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '.version_select at 0x7ff1dd1018b0>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:55.345891 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc9232c0-e636-4be7-b7b5-ad68d4c4a5fb tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453292184" status: 202 len: 0 microversion: 2.1 time: 0.023935 Jul 21 23:16:55.346471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1528/2913] 10.222.0.42 () {58 vars in 1220 bytes} [Thu Jul 21 23:16:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453292184 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:16:55.966074 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e559eb4-c117-44e2-b61d-a2800902717b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: .version_select at 0x7ff1d8d9fca0>, body: {"keypair": {"name": "tempest-keypair-625659249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCopaYQyAcxcKC3RSsPQfN+mZwbHU5cxoYPc2z4yH1Twh/QFfyuZ7cls0+bR6D/ea8cwmUaBBDjh1XxHBGgiyK7NdpRnjzGLuyuwrEAylcWNCmwSvskrwSGTEFWNky/GZA=="}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:55.980520 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-2e559eb4-c117-44e2-b61d-a2800902717b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:16:55.985133 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-2e559eb4-c117-44e2-b61d-a2800902717b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:16:56.007020 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e559eb4-c117-44e2-b61d-a2800902717b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044974 Jul 21 23:16:56.007601 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1386/2914] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:16:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:16:57.437759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1719096286", "imageRef": "a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd"}], "security_groups": [{"name": "tempest-securitygroup--1118367810"}], "key_name": "tempest-keypair-625659249", "user_data": "}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:16:57.537412 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] validate_networks() for [('9b4e60c5-2e0d-4a7a-8f66-2e87431fc7cd', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:16:57.893441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:16:57.893867 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:16:57.894338 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:16:57.894741 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:16:57.895148 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:16:57.905208 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:57.905653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:57.906457 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:57.906894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:57.924225 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:16:57.928255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Getting quotas for user 83b51eb318cf4267bbea75301a37d321 and project dc66bd1d7d6b4d52b9f9bcd96f48b192. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:16:57.939622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:16:57.942140 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a14c20f7-dad7-4b29-99eb-0de5ac1a1bbb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:16:57.989898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2b71dba4-ae70-4f24-bf18-40ec6bdaa8bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.556596 Jul 21 23:16:57.990534 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1529/2915] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:16:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:16:58.000503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-63c09ef4-3c99-434f-bff1-e1a7710b4b7e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:58.001120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-63c09ef4-3c99-434f-bff1-e1a7710b4b7e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:58.062138 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-63c09ef4-3c99-434f-bff1-e1a7710b4b7e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:58.070011 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-63c09ef4-3c99-434f-bff1-e1a7710b4b7e tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1241 microversion: 2.1 time: 0.073461 Jul 21 23:16:58.070910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1387/2916] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:57 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:16:59.087423 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:16:59.088139 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:16:59.095323 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:59.095777 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:59.096568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:16:59.097006 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:16:59.162351 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:16:59.173164 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8d7d126f-b061-44fc-a777-3d99d0ff302c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1301 microversion: 2.1 time: 0.090042 Jul 21 23:16:59.173988 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1530/2917] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:16:59 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:00.190269 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:00.190865 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:00.197381 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:00.197827 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:00.198605 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:00.199073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:00.420245 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:00.430234 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-e6f65367-bd3c-4973-a5f2-a482c60bf553 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.243742 Jul 21 23:17:00.431289 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1388/2918] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:00 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:17:00.665170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-cb835ef9-bb10-4d91-8d75-9f126b9114cc req-76c71d5b-8fa7-4408-8840-88334b46fe44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3de51d-dbea-416e-98fc-bc453370f9f2", "tag": "922f071b-5c46-4b0e-ae68-7215beb06978"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:17:00.697564 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-cb835ef9-bb10-4d91-8d75-9f126b9114cc req-76c71d5b-8fa7-4408-8840-88334b46fe44 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:00.699133 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-cb835ef9-bb10-4d91-8d75-9f126b9114cc req-76c71d5b-8fa7-4408-8840-88334b46fe44 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:00.716210 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-cb835ef9-bb10-4d91-8d75-9f126b9114cc req-76c71d5b-8fa7-4408-8840-88334b46fe44 service nova] Creating event network-changed:922f071b-5c46-4b0e-ae68-7215beb06978 for instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 on hv-cinder-85069 Jul 21 23:17:00.722019 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-cb835ef9-bb10-4d91-8d75-9f126b9114cc req-76c71d5b-8fa7-4408-8840-88334b46fe44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067714 Jul 21 23:17:00.722796 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1531/2919] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:01.447184 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:01.447795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:01.455032 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:01.455478 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:01.456227 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:01.456690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:01.588864 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:01.597019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a1b52405-9729-455f-a277-7f92cfecf521 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.153651 Jul 21 23:17:01.597582 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1389/2920] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:01 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:02.614949 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:02.615653 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:02.622383 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:02.622970 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:02.623733 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:02.624166 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:02.757386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:02.765315 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-57c50340-ade4-40fd-89c7-3896cbfa748d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.154841 Jul 21 23:17:02.765877 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1532/2921] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:02 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:03.782715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:03.783352 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:03.789795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:03.790246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:03.791008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:03.791446 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:03.921959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:03.929611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9011ae2f-1d15-44f6-9348-0a954f5ee4e1 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.151473 Jul 21 23:17:03.930219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1390/2922] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:03 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:04.946963 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:04.947505 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:04.953978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:04.954458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:04.955213 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:04.955646 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:05.085547 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:05.093585 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-99537b33-dc13-46af-bc04-4c4918c87d01 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.150537 Jul 21 23:17:05.094153 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1533/2923] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:04 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:05.941172 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-b1c48542-2cad-4396-bed8-a68060fefedd req-a553ed8f-9635-4f8c-bf25-8e453e5e8bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3de51d-dbea-416e-98fc-bc453370f9f2", "name": "network-vif-plugged", "status": "completed", "tag": "922f071b-5c46-4b0e-ae68-7215beb06978"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:17:05.949469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b1c48542-2cad-4396-bed8-a68060fefedd req-a553ed8f-9635-4f8c-bf25-8e453e5e8bd6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:05.949901 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-b1c48542-2cad-4396-bed8-a68060fefedd req-a553ed8f-9635-4f8c-bf25-8e453e5e8bd6 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:05.962129 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-b1c48542-2cad-4396-bed8-a68060fefedd req-a553ed8f-9635-4f8c-bf25-8e453e5e8bd6 service nova] Creating event network-vif-plugged:922f071b-5c46-4b0e-ae68-7215beb06978 for instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 on hv-cinder-85069 Jul 21 23:17:05.968272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-b1c48542-2cad-4396-bed8-a68060fefedd req-a553ed8f-9635-4f8c-bf25-8e453e5e8bd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029876 Jul 21 23:17:05.968904 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1391/2924] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:06.111054 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:06.111661 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:06.118481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:06.118939 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:06.119737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:06.120163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:06.250163 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:06.257441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-129e37ee-66a3-444e-9f77-14f05c15977c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.151023 Jul 21 23:17:06.258000 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1534/2925] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:06 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:07.275773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:07.276506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:07.283760 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:07.284217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:07.285001 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:07.285441 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:07.421711 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:07.429131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-00fee83b-15c5-49e0-83d2-cb2fcd50f59c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1367 microversion: 2.1 time: 0.158138 Jul 21 23:17:07.429690 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1392/2926] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:07 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:08.445258 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:08.445798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:08.448266 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:08.448968 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=6 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:08.455694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:08.456136 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:08.456913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:08.457346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:08.584824 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:08.592737 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-e5daa9bc-6cec-4147-9f3b-b18d94c05959 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1555 microversion: 2.1 time: 0.151442 Jul 21 23:17:08.593292 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1535/2927] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:08 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:08.609340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:08.609860 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:08.611795 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=6 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:08.617652 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:08.618094 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:08.618847 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:08.619286 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:08.694016 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-fd522994-6654-4afa-ae32-233e8bd7107c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089130 Jul 21 23:17:08.694616 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1393/2928] 10.222.0.42 () {58 vars in 1274 bytes} [Thu Jul 21 23:17:08 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:09.876419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-c6825a49-8d2c-43dd-9b26-0c60fc3ac771 req-f3833d81-f1e3-4d4b-9a33-e61cc4c800c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3de51d-dbea-416e-98fc-bc453370f9f2", "tag": "922f071b-5c46-4b0e-ae68-7215beb06978"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:17:09.884984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-c6825a49-8d2c-43dd-9b26-0c60fc3ac771 req-f3833d81-f1e3-4d4b-9a33-e61cc4c800c7 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:09.885438 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-c6825a49-8d2c-43dd-9b26-0c60fc3ac771 req-f3833d81-f1e3-4d4b-9a33-e61cc4c800c7 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:09.896272 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-c6825a49-8d2c-43dd-9b26-0c60fc3ac771 req-f3833d81-f1e3-4d4b-9a33-e61cc4c800c7 service nova] Creating event network-changed:922f071b-5c46-4b0e-ae68-7215beb06978 for instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 on hv-cinder-85069 Jul 21 23:17:09.901313 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-c6825a49-8d2c-43dd-9b26-0c60fc3ac771 req-f3833d81-f1e3-4d4b-9a33-e61cc4c800c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029208 Jul 21 23:17:09.902072 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1536/2929] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:44.667581 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:44.668385 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:44.672655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:44.673155 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:44.682081 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:44.682537 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:44.683354 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:44.683750 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:44.708264 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-516cf9d2-93a7-4742-86b8-1ca4fffc1453 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/ips" status: 200 len: 146 microversion: 2.1 time: 0.042115 Jul 21 23:17:44.708871 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1394/2930] 10.222.0.42 () {58 vars in 1247 bytes} [Thu Jul 21 23:17:44 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:46.019678 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9ed0e1a-4d12-4fca-b094-7ddd2691e89f"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:17:46.021001 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:46.023115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:46.023759 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:17:46.029840 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:46.030295 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:46.031053 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:46.031488 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:46.293529 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-a44844e2-02ec-4e3e-b97d-a869c7d97bb5 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "POST /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278916 Jul 21 23:17:46.294141 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1537/2931] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:17:46 2022] POST /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:53.872078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:53.872634 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:53.878684 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:53.879146 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:53.879909 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:53.880355 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:54.012849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lazy-loading 'services' on Instance uuid 7e3de51d-dbea-416e-98fc-bc453370f9f2 {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:17:54.085344 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-6d4fcb41-a329-40cd-94a5-f1e3ea4df69d tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments/a9ed0e1a-4d12-4fca-b094-7ddd2691e89f" status: 202 len: 0 microversion: 2.1 time: 0.217199 Jul 21 23:17:54.085932 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1395/2932] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:17:53 2022] DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments/a9ed0e1a-4d12-4fca-b094-7ddd2691e89f => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:17:54.095371 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:54.097541 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:54.103903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:54.104346 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:54.105127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:54.105738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:54.136118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-4ba7f645-5976-43e2-b888-baa5c724454c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Jul 21 23:17:54.136847 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1538/2933] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:17:54 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:55.148593 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:55.149703 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:55.156277 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.156754 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.157523 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.157966 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.187057 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-95ee3fbf-f2e2-4d85-971e-73fd4d02d790 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043390 Jul 21 23:17:55.187618 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1396/2934] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:17:55 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:17:55.243642 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:55.244144 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:55.250426 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.250866 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.251607 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.252033 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.276307 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:17:55.352979 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6d2eae50-154c-4283-89ba-238fd71f2a27 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 204 len: 0 microversion: 2.1 time: 0.112445 Jul 21 23:17:55.353818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1539/2935] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:17:55 2022] DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:17:55.362686 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:55.363325 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:55.369624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.370079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.370840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:55.371280 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:55.500590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:55.508622 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-388df5db-3e8a-4279-90cc-13653be0b40b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1678 microversion: 2.1 time: 0.150335 Jul 21 23:17:55.509222 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1397/2936] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:55 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:17:56.526181 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:56.526875 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:56.533376 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:56.533817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:56.535282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:56.535715 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:56.662350 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:56.669694 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8595f3cb-9fa7-488d-87da-5e360d688a7c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1678 microversion: 2.1 time: 0.147698 Jul 21 23:17:56.670255 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1540/2937] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:56 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:57.687882 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:57.688518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:57.699862 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:57.700315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:57.701128 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:57.701565 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:57.809246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b51eb318cf4267bbea75301a37d321', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc66bd1d7d6b4d52b9f9bcd96f48b192', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:17:57.817326 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-b10870b5-dc02-46e0-9d08-120ced9837e6 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 200 len: 1610 microversion: 2.1 time: 0.133685 Jul 21 23:17:57.817961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1398/2938] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:57 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 1610 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:17:58.042599 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-95446e65-1fa3-448b-bad2-3164313d4e1a req-0f66c2b5-1e8f-435f-b7c6-2818867bef4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3de51d-dbea-416e-98fc-bc453370f9f2", "name": "network-vif-deleted", "tag": "922f071b-5c46-4b0e-ae68-7215beb06978"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:17:58.060260 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-95446e65-1fa3-448b-bad2-3164313d4e1a req-0f66c2b5-1e8f-435f-b7c6-2818867bef4f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:58.060795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-95446e65-1fa3-448b-bad2-3164313d4e1a req-0f66c2b5-1e8f-435f-b7c6-2818867bef4f service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:58.076305 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-95446e65-1fa3-448b-bad2-3164313d4e1a req-0f66c2b5-1e8f-435f-b7c6-2818867bef4f service nova] Creating event network-vif-deleted:922f071b-5c46-4b0e-ae68-7215beb06978 for instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 on hv-cinder-85069 Jul 21 23:17:58.083480 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-95446e65-1fa3-448b-bad2-3164313d4e1a req-0f66c2b5-1e8f-435f-b7c6-2818867bef4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050979 Jul 21 23:17:58.084834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1541/2939] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:17:58.835338 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:58.835950 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:17:58.842507 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:58.842960 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:58.843737 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:17:58.844171 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:17:58.858454 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 HTTP/1.1 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:17:58.860625 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:17:58.862332 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '7e3de51d-dbea-416e-98fc-bc453370f9f2'} Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:17:58.863250 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:17:58.865275 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:17:58.867064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:17:58.867064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-17a3a363-4c15-4435-ab70-64295de45475 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 404 len: 111 microversion: 2.1 time: 0.031708 Jul 21 23:17:58.867064 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1399/2940] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:17:58 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:17:58.872707 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-3ea4b24f-5bfd-45d8-98c2-14ef5f152503 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '.version_select at 0x7ff1dd106e50>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:17:58.892405 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-3ea4b24f-5bfd-45d8-98c2-14ef5f152503 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-625659249" status: 202 len: 0 microversion: 2.1 time: 0.023832 Jul 21 23:17:58.893015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1542/2941] 10.222.0.42 () {58 vars in 1217 bytes} [Thu Jul 21 23:17:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-625659249 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:18:00.634906 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:00.635394 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:00.641910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:00.642362 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:00.643125 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:00.643566 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:00.657230 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 HTTP/1.1 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:18:00.658752 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.661248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '7e3de51d-dbea-416e-98fc-bc453370f9f2'} Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:00.662281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.663931 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.665873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:00.665873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-d66fb0bc-1b2b-4d71-910e-b3ea484bac3b tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 404 len: 111 microversion: 2.1 time: 0.029048 Jul 21 23:18:00.665873 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1400/2942] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:18:00 2022] DELETE /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:00.669361 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:00.670107 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 7e3de51d-dbea-416e-98fc-bc453370f9f2] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:00.676738 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:00.677199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:00.677966 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:00.678407 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:00.691603 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 HTTP/1.1 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:18:00.693196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.694982 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '7e3de51d-dbea-416e-98fc-bc453370f9f2'} Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:00.695874 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. Jul 21 23:18:00.697391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:00.698681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 7e3de51d-dbea-416e-98fc-bc453370f9f2 could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:00.698681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1e0d0591-934b-464c-b947-2a181cec678f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2" status: 404 len: 111 microversion: 2.1 time: 0.029284 Jul 21 23:18:00.698681 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1543/2943] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:00 2022] GET /compute/v2.1/servers/7e3de51d-dbea-416e-98fc-bc453370f9f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:01.827608 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:01.828106 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:01.834963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.835416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.836235 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.836704 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.849777 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f HTTP/1.1 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:18:01.851360 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.853261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'ec116155-1520-493b-b297-2ba1189abc3f'} Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:01.854293 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.856024 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.857895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:01.857895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a7a6bb49-26f1-4f71-b107-887e760cd9bd tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 404 len: 111 microversion: 2.1 time: 0.028963 Jul 21 23:18:01.857895 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1401/2944] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:18:01 2022] DELETE /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:01.861234 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:01.861882 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: ec116155-1520-493b-b297-2ba1189abc3f] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:01.869558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.870005 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.870987 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.871196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.886498 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f HTTP/1.1 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:18:01.888020 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.889871 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'ec116155-1520-493b-b297-2ba1189abc3f'} Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:01.890771 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. Jul 21 23:18:01.892510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.894114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance ec116155-1520-493b-b297-2ba1189abc3f could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:01.894114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d1b000ba-6a57-4504-9c78-da7a384227dc tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f" status: 404 len: 111 microversion: 2.1 time: 0.032192 Jul 21 23:18:01.894114 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1544/2945] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:01 2022] GET /compute/v2.1/servers/ec116155-1520-493b-b297-2ba1189abc3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:01.899579 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:01.900063 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:01.906407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.906853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.907604 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.908036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.921740 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b HTTP/1.1 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:18:01.923261 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.925078 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '57ab196d-4974-4f08-8ee9-d568cd6d6c6b'} Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:01.926826 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.928614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.930297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:01.930297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-720847d9-96d2-461a-8053-6578f81ccb57 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 404 len: 111 microversion: 2.1 time: 0.029091 Jul 21 23:18:01.930297 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1402/2946] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:18:01 2022] DELETE /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:01.933356 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:01.933972 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: 57ab196d-4974-4f08-8ee9-d568cd6d6c6b] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:01.939961 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.940413 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.941837 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:01.942283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:01.955368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b HTTP/1.1 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:18:01.957618 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.959419 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': '57ab196d-4974-4f08-8ee9-d568cd6d6c6b'} Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:01.960602 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. Jul 21 23:18:01.962393 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:01.963978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance 57ab196d-4974-4f08-8ee9-d568cd6d6c6b could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:01.963978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-afdbb790-fa84-46a5-986b-8eb8eda407d2 tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b" status: 404 len: 111 microversion: 2.1 time: 0.029668 Jul 21 23:18:01.963978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1545/2947] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:01 2022] GET /compute/v2.1/servers/57ab196d-4974-4f08-8ee9-d568cd6d6c6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:03.088436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:03.088971 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:03.095528 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:03.095979 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:03.096773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:03.097207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:03.111190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a HTTP/1.1 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:18:03.112769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.114712 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': 'e97e990a-7b8d-4c84-bdc7-d7c69421915a'} Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:03.115782 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.117279 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.119304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:03.119304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-a561ee88-64ba-485d-8b70-7765cde0b91c tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 404 len: 111 microversion: 2.1 time: 0.029730 Jul 21 23:18:03.119304 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1403/2948] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:18:03 2022] DELETE /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:03.122803 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:03.123442 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] [instance: e97e990a-7b8d-4c84-bdc7-d7c69421915a] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:03.130487 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:03.130934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:03.131692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:03.132125 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:03.146384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.wsgi [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] HTTP exception thrown: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Request method failure captured: Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: request: GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a HTTP/1.1 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept: application/json Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Accept-Encoding: identity Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Connection: close Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Length: 0 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Content-Type: application/json Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Host: 10.222.0.42 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Openstack-System-Scope: None Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: User-Agent: python-urllib3/1.26.9 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Auth-Token: gAAAAABi2d2wlNZhd1z7nCZgR_Kl91816Fv5RcUtj7sjXClg4GRNql36LM2bycqmXwlvREszY7dEHcz6Ddcj32ZAvw06xOGPs6vpJGvOj2VYLGh9QybFDdv8caDlgah0fsCuQftIoqZkcOfOCpiws_q5YSuvVrANHp10jN_eEgJxfdWRriYhbzM Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Id: None Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Domain-Name: None Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Identity-Status: Confirmed Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Is-Admin-Project: True Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Id: default Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Domain-Name: Default Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Project-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Role: reader,member Jul 21 23:18:03.147940 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Roles: reader,member Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc66bd1d7d6b4d52b9f9bcd96f48b192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Id: dc66bd1d7d6b4d52b9f9bcd96f48b192 Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1877393073 Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Id: default Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Domain-Name: Default Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Id: 83b51eb318cf4267bbea75301a37d321 Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: X-User-Name: tempest-AttachVolumeNegativeTest-1877393073-project Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: method: > Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: exception: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.150312 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: action_args: {'id': 'e97e990a-7b8d-4c84-bdc7-d7c69421915a'} Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:18:03.151494 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. Jul 21 23:18:03.153120 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: ERROR nova.api.openstack.wsgi Jul 21 23:18:03.154685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] Returning 404 to user: Instance e97e990a-7b8d-4c84-bdc7-d7c69421915a could not be found. {{(pid=124535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:18:03.154685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-b8089776-7bee-4186-9d08-b6929eb20b0f tempest-AttachVolumeNegativeTest-1877393073 tempest-AttachVolumeNegativeTest-1877393073-project] 10.222.0.42 "GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a" status: 404 len: 111 microversion: 2.1 time: 0.030300 Jul 21 23:18:03.154685 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1546/2949] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:03 2022] GET /compute/v2.1/servers/e97e990a-7b8d-4c84-bdc7-d7c69421915a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:18:54.094191 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-51918640-2323-472f-b00e-6f95c98fc0bf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'create', calling method: .version_select at 0x7ff1d89b1940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1907951686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOPjemOffgS1TDKUSuVofWXO5LPGT8HtADFdl3NNtmuzfRckDADc4BB+RVUKvgTIdU4y8LxwnWtgrEevcgoqW03f4zWXRT8UOBIiqi6eLmmhAvVOthsR+/sapw9nKM73Q=="}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:18:54.098469 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=20 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:18:54.099113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:18:54.112423 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-51918640-2323-472f-b00e-6f95c98fc0bf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Getting quotas for project d72850690b7f447fbbb9a30e1bc1fc78. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:18:54.116219 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.quota [None req-51918640-2323-472f-b00e-6f95c98fc0bf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Getting quotas for user 4c2cdf754ca24afd88329cd456f1c9d2 and project d72850690b7f447fbbb9a30e1bc1fc78. Resources: {'key_pairs'} {{(pid=124534) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:18:54.139041 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-51918640-2323-472f-b00e-6f95c98fc0bf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048714 Jul 21 23:18:54.139624 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1404/2950] 10.222.0.42 () {60 vars in 1158 bytes} [Thu Jul 21 23:18:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:18:54.188609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-60534854", "imageRef": "a608da1a-8ac2-43a9-9f50-7c3abedd8fd1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1907951686", "networks": [{"uuid": "fec82779-dbca-4a8e-b558-b2838c521ea3"}]}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:18:54.195997 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:18:54.196770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:18:54.240150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.network.neutron [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] validate_networks() for [('fec82779-dbca-4a8e-b558-b2838c521ea3', None, None, None, None, None)] {{(pid=124535) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 23:18:54.608770 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Flavor limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 23:18:54.609188 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Image limits 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 23:18:54.609658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Flavor pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 23:18:54.610063 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Image pref 0:0:0 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 23:18:54.610468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.virt.hardware [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124535) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 23:18:54.619768 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:54.620493 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:54.621283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:54.621711 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:54.638910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Getting quotas for project d72850690b7f447fbbb9a30e1bc1fc78. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 23:18:54.642794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.quota [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Getting quotas for user 4c2cdf754ca24afd88329cd456f1c9d2 and project d72850690b7f447fbbb9a30e1bc1fc78. Resources: {'cores', 'ram', 'instances'} {{(pid=124535) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 23:18:54.654427 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Going to run 1 instances... {{(pid=124535) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 23:18:54.656634 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a608da1a-8ac2-43a9-9f50-7c3abedd8fd1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124535) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 23:18:54.702268 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-2812f659-cd5a-4fa0-8ac7-a308d2128055 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517611 Jul 21 23:18:54.702913 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1547/2951] 10.222.0.42 () {60 vars in 1146 bytes} [Thu Jul 21 23:18:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 23:18:54.712849 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-970296c5-f800-4cc3-aee6-9a196115c4b7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:54.713512 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-970296c5-f800-4cc3-aee6-9a196115c4b7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:54.770631 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-970296c5-f800-4cc3-aee6-9a196115c4b7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:18:54.777888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-970296c5-f800-4cc3-aee6-9a196115c4b7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1257 microversion: 2.1 time: 0.069072 Jul 21 23:18:54.778463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1405/2952] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:54 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:18:55.794667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8faa441d-570f-4198-a952-9a447a00aad3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:55.795316 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8faa441d-570f-4198-a952-9a447a00aad3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:55.848471 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8faa441d-570f-4198-a952-9a447a00aad3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:18:55.855365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8faa441d-570f-4198-a952-9a447a00aad3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1257 microversion: 2.1 time: 0.065316 Jul 21 23:18:55.855921 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1548/2953] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:55 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:18:56.871962 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2291212d-2613-49cc-bce7-3c993972cd79 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:56.872696 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2291212d-2613-49cc-bce7-3c993972cd79 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:56.929021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2291212d-2613-49cc-bce7-3c993972cd79 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:18:56.936698 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2291212d-2613-49cc-bce7-3c993972cd79 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1257 microversion: 2.1 time: 0.069366 Jul 21 23:18:56.937248 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1406/2954] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:56 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:18:57.953041 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-fc00d3dc-caa5-449d-9a8f-263b59f5fcef tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:57.953647 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-fc00d3dc-caa5-449d-9a8f-263b59f5fcef tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:58.007459 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-fc00d3dc-caa5-449d-9a8f-263b59f5fcef tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:18:58.014897 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-fc00d3dc-caa5-449d-9a8f-263b59f5fcef tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1257 microversion: 2.1 time: 0.065766 Jul 21 23:18:58.015458 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1549/2955] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:57 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:18:59.032120 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:18:59.032765 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:18:59.039769 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:59.040221 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:59.041058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:18:59.041496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:18:59.100272 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:18:59.108165 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-514bd4fb-b2e8-4b85-a41f-cba3a0a77d02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1261 microversion: 2.1 time: 0.079925 Jul 21 23:18:59.108755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1407/2956] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:18:59 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 23:19:00.126190 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:00.126806 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:00.133674 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:00.134022 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:00.134787 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:00.135226 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:00.205652 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:00.213282 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-6c3b0ba2-9dfa-4f2d-80e1-da4295f99fc5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1315 microversion: 2.1 time: 0.090989 Jul 21 23:19:00.218984 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1550/2957] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:00 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:01.231246 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:01.231780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:01.239102 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:01.239635 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:01.240437 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:01.240907 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:01.389477 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:01.397543 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-563af85c-9305-451b-9dd3-27073715e7cc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.171169 Jul 21 23:19:01.405715 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1408/2958] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:01 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:02.415834 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:02.416582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:02.424043 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:02.424679 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:02.425469 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:02.425903 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:02.583869 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:02.592810 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7cc973e4-55f0-4bf3-a16f-b2988d0e3daf tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.181105 Jul 21 23:19:02.593995 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1551/2959] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:02 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:03.314111 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:19:03.314700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:19:03.610427 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:03.611079 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:03.618068 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:03.618772 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:03.619568 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:03.620010 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:03.809651 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:03.818891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-10b8c75a-a0be-459d-8070-5eaf0fa2d6bd tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.212295 Jul 21 23:19:03.830220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1409/2960] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:03 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:04.841002 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:04.841795 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:04.844283 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:04.850056 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:04.850815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:04.852368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:04.853036 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:05.026713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:05.034667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f50b445d-a479-4f04-b94b-c99a9694ad62 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.199207 Jul 21 23:19:05.038179 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1552/2961] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:04 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:06.053186 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:06.053798 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:06.061335 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:06.061780 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:06.063231 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:06.064214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:06.204407 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:06.212510 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ac494457-7b47-4413-8251-d7165407c29d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.163101 Jul 21 23:19:06.213284 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1410/2962] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:06 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:07.229671 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:07.230368 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:07.236934 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:07.237384 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:07.238194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:07.238616 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:07.374910 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:07.382468 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-8313c011-0a3d-4825-9691-86767179c53b tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.157067 Jul 21 23:19:07.392017 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1553/2963] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:07 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:08.400141 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:08.400785 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:08.402614 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell0:SELECT=8 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:08.408414 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:08.408892 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:08.409668 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:08.410107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:08.542464 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:08.549900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1d474229-9ba8-43a0-9822-0e6781d5ed11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.154127 Jul 21 23:19:08.550468 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1411/2964] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:08 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:09.567513 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:09.568150 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:09.570004 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=10 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:09.576744 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:09.577194 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:09.577952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:09.578386 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:09.703215 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:09.710609 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-7e87daa5-a2dd-494c-bb16-2efbb56f72d4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.146973 Jul 21 23:19:09.712127 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1554/2965] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:09 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:10.543483 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-ada60be3-e738-4561-82b0-9d190b19ff6b req-8081454e-c92f-450d-8e17-454d8a6a8c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:10.553342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ada60be3-e738-4561-82b0-9d190b19ff6b req-8081454e-c92f-450d-8e17-454d8a6a8c27 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:10.553789 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-ada60be3-e738-4561-82b0-9d190b19ff6b req-8081454e-c92f-450d-8e17-454d8a6a8c27 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:10.569180 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-ada60be3-e738-4561-82b0-9d190b19ff6b req-8081454e-c92f-450d-8e17-454d8a6a8c27 service nova] Creating event network-changed:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:19:10.574213 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-ada60be3-e738-4561-82b0-9d190b19ff6b req-8081454e-c92f-450d-8e17-454d8a6a8c27 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035332 Jul 21 23:19:10.574880 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1412/2966] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:19:10.728353 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:10.728985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:10.735870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:10.736320 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:10.737110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:10.737559 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:10.867218 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:10.875622 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-9c7fa655-1fb8-4df8-b4aa-3ee627c19278 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.151922 Jul 21 23:19:10.876197 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1555/2967] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:10 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:11.894214 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:11.894936 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:11.901639 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:11.902087 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:11.902833 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:11.903265 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:12.062452 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:12.070152 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2fc44d34-6d44-48c4-8e5d-9560aa50156f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.180545 Jul 21 23:19:12.071497 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1413/2968] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:11 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:13.087561 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:13.088161 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:13.094554 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:13.094998 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:13.095746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:13.096172 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:13.224115 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:13.231463 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-73f59f19-3935-445a-bac4-bc8111ebc974 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.148280 Jul 21 23:19:13.232018 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1556/2969] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:13 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:14.249048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:14.249655 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:14.256513 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:14.256910 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:14.257659 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:14.258260 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:14.388416 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:14.395863 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ba515984-afb6-4326-ba1e-856fa4c026a4 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.151062 Jul 21 23:19:14.396429 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1414/2970] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:14 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:14.555484 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-f618485c-09e1-487e-ab2d-8b6916bb3d23 req-ed9f3420-a439-4c6a-8f66-47e4e9b61439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "name": "network-vif-plugged", "status": "completed", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:14.564093 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-f618485c-09e1-487e-ab2d-8b6916bb3d23 req-ed9f3420-a439-4c6a-8f66-47e4e9b61439 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:14.564550 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-f618485c-09e1-487e-ab2d-8b6916bb3d23 req-ed9f3420-a439-4c6a-8f66-47e4e9b61439 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:14.577170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-f618485c-09e1-487e-ab2d-8b6916bb3d23 req-ed9f3420-a439-4c6a-8f66-47e4e9b61439 service nova] Creating event network-vif-plugged:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:19:14.582069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-f618485c-09e1-487e-ab2d-8b6916bb3d23 req-ed9f3420-a439-4c6a-8f66-47e4e9b61439 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031062 Jul 21 23:19:14.582658 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1557/2971] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:19:15.413127 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:15.413757 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:15.420774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:15.421236 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:15.422008 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:15.422453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:15.553840 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:15.561200 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-11ca75fe-00d9-42f8-82e0-c1d08dff45fc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1357 microversion: 2.1 time: 0.151992 Jul 21 23:19:15.561755 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1415/2972] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:15 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:16.578775 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:16.579474 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:16.585623 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.586151 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:16.586833 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.587264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:16.716439 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:16.723870 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-1e3d554b-abd2-404c-810e-12830e137035 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1548 microversion: 2.1 time: 0.149912 Jul 21 23:19:16.724422 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1558/2973] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:16 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:16.740029 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:16.740674 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:16.748379 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.748861 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:16.749621 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.750058 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:16.881572 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:16.890611 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2555b431-4964-48e3-90ef-2643eedcd0d7 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1548 microversion: 2.1 time: 0.154419 Jul 21 23:19:16.891370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1416/2974] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:16 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:16.906477 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:16.910083 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:16.910854 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Searching by: {'deleted': False, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78'} {{(pid=124535) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 23:19:16.918415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.918804 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:16.919627 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:16.920027 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:17.015395 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.multi_cell_list [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124535) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 23:19:17.111898 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f6ab9e08-3cc3-4ed5-be1b-4f174f8a02ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.209102 Jul 21 23:19:17.112670 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1559/2975] 10.222.0.42 () {58 vars in 1124 bytes} [Thu Jul 21 23:19:16 2022] GET /compute/v2.1/servers => generated 341 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:19:17.123463 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:17.124082 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:17.130065 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:17.130518 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:17.131281 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:17.131719 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:17.261131 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:17.268556 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-ed0ef562-e38d-41fa-aeb3-f1d676e80ded tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1548 microversion: 2.1 time: 0.149109 Jul 21 23:19:17.269243 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1417/2976] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:17 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:18.777746 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d22de2d3-0bdd-42ea-b9e9-b869c00c5edf"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:18.778822 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:18.785196 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:18.785636 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:18.786381 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:18.786805 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:19.047101 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-403ae335-dd4e-472c-8b30-b2d4a4ed691f tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273717 Jul 21 23:19:19.047802 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1560/2977] 10.222.0.42 () {60 vars in 1322 bytes} [Thu Jul 21 23:19:18 2022] POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:19:26.582590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:26.583205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:26.585506 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:26.591471 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:26.591925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:26.592729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:26.593169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:26.596192 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=63 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:26.725025 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:26.733473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7cebfa88-0515-44d3-9cf3-94bd45c130ee tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1594 microversion: 2.1 time: 0.154725 Jul 21 23:19:26.734034 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1418/2978] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:26 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:28.637977 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell0:SELECT=2 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:28.642286 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-11d642a9-5095-4392-9a29-8a4e459c1109 req-3c01a57d-69b9-4a69-b48e-3e7b0afdc805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:28.645755 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:28.652779 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-11d642a9-5095-4392-9a29-8a4e459c1109 req-3c01a57d-69b9-4a69-b48e-3e7b0afdc805 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:28.653237 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-11d642a9-5095-4392-9a29-8a4e459c1109 req-3c01a57d-69b9-4a69-b48e-3e7b0afdc805 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:28.658167 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:28.667714 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-11d642a9-5095-4392-9a29-8a4e459c1109 req-3c01a57d-69b9-4a69-b48e-3e7b0afdc805 service nova] Creating event network-changed:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:19:28.673365 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-11d642a9-5095-4392-9a29-8a4e459c1109 req-3c01a57d-69b9-4a69-b48e-3e7b0afdc805 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036634 Jul 21 23:19:28.674010 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1561/2979] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:19:29.759075 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-794269781"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:29.759867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:29.766679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:29.767135 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:29.767902 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:29.768339 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:29.903473 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.network.security_group_api [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Adding security group 8eb8a5e3-25d5-40b9-9fd9-e5d4f44cc11c to port 0dbee7c0-bac8-4e3a-bd28-031ee36af53a Jul 21 23:19:30.249431 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-2e978eda-2588-4a30-8096-39e9e4a15431 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action" status: 202 len: 0 microversion: 2.1 time: 0.494903 Jul 21 23:19:30.250808 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1419/2980] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:19:29 2022] POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:19:30.260137 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-a3a438ac-f3ad-4f2b-a6fb-b9fe444d2c2c req-06de0a82-40f9-4dc9-b45f-1c3e6e824ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:30.262273 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:30.262891 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:30.269952 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:30.271574 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:30.272580 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:30.272788 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-a3a438ac-f3ad-4f2b-a6fb-b9fe444d2c2c req-06de0a82-40f9-4dc9-b45f-1c3e6e824ad8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:30.273298 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-a3a438ac-f3ad-4f2b-a6fb-b9fe444d2c2c req-06de0a82-40f9-4dc9-b45f-1c3e6e824ad8 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:30.273489 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:30.294576 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-a3a438ac-f3ad-4f2b-a6fb-b9fe444d2c2c req-06de0a82-40f9-4dc9-b45f-1c3e6e824ad8 service nova] Creating event network-changed:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:19:30.307964 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-a3a438ac-f3ad-4f2b-a6fb-b9fe444d2c2c req-06de0a82-40f9-4dc9-b45f-1c3e6e824ad8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053792 Jul 21 23:19:30.309256 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1562/2981] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:19:30.548455 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:30.556964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9023dcc9-7883-4133-b59b-9ec0c4cf6c02 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1759 microversion: 2.1 time: 0.298334 Jul 21 23:19:30.557680 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1420/2982] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:30 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1759 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:53.088815 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:53.089818 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=3 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:53.094143 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:19:53.095170 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:53.102069 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:53.102517 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:53.103265 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:53.103696 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:53.175773 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5d6de60c-93cb-4989-959d-e1731f3a7adb tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action" status: 202 len: 0 microversion: 2.1 time: 0.088242 Jul 21 23:19:53.176601 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1563/2983] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:19:53 2022] POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:19:53.185529 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:53.186220 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:53.188504 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=5 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:53.189215 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=15 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:19:53.195006 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:53.195450 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:53.196207 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:53.196676 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:53.437073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:53.445145 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-26394ab1-2e83-4e1d-815c-15ecc973f16d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1751 microversion: 2.1 time: 0.264407 Jul 21 23:19:53.445961 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1421/2984] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:53 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1751 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:54.463878 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:54.465546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:54.471643 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:54.472086 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:54.472864 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:54.473294 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:54.613978 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:54.622391 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d809d779-8ca6-40c9-a624-bf1663ecdb1a tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.162732 Jul 21 23:19:54.622563 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1564/2985] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:54 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:55.639196 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:55.639806 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:55.646198 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:55.646642 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:55.647389 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:55.647820 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:55.790773 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:55.799409 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-9f02a007-7565-493f-899e-c000367c5e25 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.164298 Jul 21 23:19:55.799963 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1422/2986] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:55 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:56.815497 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:56.816105 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:56.822582 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:56.823026 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:56.823798 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:56.824233 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:56.964030 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:56.972565 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-83cd5d14-78b0-48fb-a27b-a7931a2ba6db tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.160861 Jul 21 23:19:56.973118 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1565/2987] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:56 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:57.990091 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:57.990699 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:57.997348 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:57.998036 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:57.998794 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:57.999223 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:58.138590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:58.146453 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-92a652a2-dded-48ea-94e5-3905f098db7d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.160308 Jul 21 23:19:58.147023 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1423/2988] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:57 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:19:59.164261 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:19:59.164894 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:19:59.171568 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:59.172015 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:59.172794 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:19:59.173227 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:19:59.315220 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:19:59.323032 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-f01d74b1-1bf8-478c-a15b-929f5178e8f3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.162616 Jul 21 23:19:59.323590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1566/2989] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:19:59 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:00.341258 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:00.341870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:00.348390 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:00.348879 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:00.349640 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:00.350076 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:00.492340 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:00.500606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-89ebca84-b438-476f-a4c3-77439bce9cd0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.163959 Jul 21 23:20:00.501169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1424/2990] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:00 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:01.518373 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:01.518985 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:01.525522 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:01.525974 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:01.526727 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:01.527666 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:01.667571 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:01.676257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c3a126fb-df45-4fb0-ad26-153e4c821288 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.161754 Jul 21 23:20:01.676855 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1567/2991] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:01 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:02.693167 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:02.693700 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:02.700205 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:02.700682 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:02.701436 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:02.701867 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:02.845923 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:02.853767 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-669f2ac3-efde-43f3-b2fe-9b31957500d3 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.164545 Jul 21 23:20:02.854328 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1425/2992] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:02 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:03.871957 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:03.873388 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:03.880100 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:03.880605 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:03.881355 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:03.881781 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:04.024509 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:04.033415 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d9d780ef-23d7-4ee3-963b-1719172a02b5 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.165646 Jul 21 23:20:04.034418 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1568/2993] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:03 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:05.051084 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:05.051844 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:05.058718 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:05.059169 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:05.059925 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:05.060357 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:05.209542 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:05.217888 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-4f622ed4-284a-41d2-ad32-5b2e1920bdcc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1756 microversion: 2.1 time: 0.170711 Jul 21 23:20:05.218459 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1426/2994] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:05 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:06.235638 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:06.236250 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:06.242651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:06.243097 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:06.243848 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:06.244279 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:06.384650 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:06.400651 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-673f1a3e-70e4-4ba7-85a5-314ea74deef1 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1759 microversion: 2.1 time: 0.168829 Jul 21 23:20:06.401217 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1569/2995] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:06 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:38.757276 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-794269781"}} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:20:38.757809 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:38.759717 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_api:SELECT=12 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:20:38.760371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG dbcounter [-] [124534] Writing DB stats nova_cell1:SELECT=36 {{(pid=124534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:20:38.766225 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:38.766679 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:38.767445 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:38.767886 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:38.896370 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.network.security_group_api [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Removing security group 8eb8a5e3-25d5-40b9-9fd9-e5d4f44cc11c from port 0dbee7c0-bac8-4e3a-bd28-031ee36af53a Jul 21 23:20:39.224503 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-f21c202e-51b2-412d-87c2-b443f42083b9 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action" status: 202 len: 0 microversion: 2.1 time: 0.471295 Jul 21 23:20:39.225113 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1427/2996] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Jul 21 23:20:38 2022] POST /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:20:39.239546 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_api:SELECT=14 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:20:39.241510 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG dbcounter [-] [124535] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 23:20:39.422664 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-6d58ce3b-584c-49c7-9cc0-db26175cf3ff req-4fa08e12-1ba9-4786-a4c4-679f50b50622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:20:39.432911 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6d58ce3b-584c-49c7-9cc0-db26175cf3ff req-4fa08e12-1ba9-4786-a4c4-679f50b50622 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:39.433841 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-6d58ce3b-584c-49c7-9cc0-db26175cf3ff req-4fa08e12-1ba9-4786-a4c4-679f50b50622 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:39.449850 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-6d58ce3b-584c-49c7-9cc0-db26175cf3ff req-4fa08e12-1ba9-4786-a4c4-679f50b50622 service nova] Creating event network-changed:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:20:39.457722 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-6d58ce3b-584c-49c7-9cc0-db26175cf3ff req-4fa08e12-1ba9-4786-a4c4-679f50b50622 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222601 Jul 21 23:20:39.458758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1570/2997] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:20:40.978371 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:40.979048 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:40.986343 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:40.986908 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:40.987774 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:40.988282 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:41.071241 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.objects.instance [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lazy-loading 'services' on Instance uuid 47c03a62-cc05-4783-986b-603c9a4eeccb {{(pid=124534) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 23:20:41.145422 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-bcbf71af-d5bc-46c4-a801-f3dbffd35a81 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments/d22de2d3-0bdd-42ea-b9e9-b869c00c5edf" status: 202 len: 0 microversion: 2.1 time: 0.171297 Jul 21 23:20:41.146103 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1428/2998] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:20:40 2022] DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments/d22de2d3-0bdd-42ea-b9e9-b869c00c5edf => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:20:41.156692 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:41.157952 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:41.165157 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:41.165713 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:41.166590 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:41.167199 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:41.196971 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-c9af7bfc-6a48-4182-83cc-7d4f093637bc tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Jul 21 23:20:41.197445 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1571/2999] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:20:41 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:20:41.473606 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [req-48246630-f145-4808-a123-0c55e88a8487 req-ab1b7f81-ce3d-4dc7-b0d6-abc8568896a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:20:41.482854 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-48246630-f145-4808-a123-0c55e88a8487 req-ab1b7f81-ce3d-4dc7-b0d6-abc8568896a3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:41.483301 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [req-48246630-f145-4808-a123-0c55e88a8487 req-ab1b7f81-ce3d-4dc7-b0d6-abc8568896a3 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:41.494786 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.compute.server_external_events [req-48246630-f145-4808-a123-0c55e88a8487 req-ab1b7f81-ce3d-4dc7-b0d6-abc8568896a3 service nova] Creating event network-changed:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:20:41.499855 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [req-48246630-f145-4808-a123-0c55e88a8487 req-ab1b7f81-ce3d-4dc7-b0d6-abc8568896a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 Jul 21 23:20:41.500448 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1429/3000] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 23:20:42.212040 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:42.214580 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:42.223441 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:42.223936 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:42.225584 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:42.226975 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:42.258092 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-d7403178-f796-4f9b-8ca9-04a288d46b60 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051224 Jul 21 23:20:42.258793 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1572/3001] 10.222.0.42 () {58 vars in 1301 bytes} [Thu Jul 21 23:20:42 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 23:20:42.270217 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:42.270802 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:42.277021 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:42.278019 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:42.278900 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:42.279342 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:42.354051 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] HTTP exception thrown: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb is not attached to volume d22de2d3-0bdd-42ea-b9e9-b869c00c5edf Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Request method failure captured: Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments/d22de2d3-0bdd-42ea-b9e9-b869c00c5edf HTTP/1.1 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d7P1VmkY3FdFPEpGT5gigRM5iEI-Ym_UmSjOPD3qC2eCyIKtIuSEl0Q7XCo6wORNxrZWozy5C0iRJYZ7lefG0xS1nn5PKjnAByiAsT0dLQY27__cfxP8DceaFZ3F6yZn3n1Am8ADBOjIcwPlFS_mJiK-pPeY0OuE2V_zFHpuDPr1ic Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: d72850690b7f447fbbb9a30e1bc1fc78 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:20:42.356586 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: d72850690b7f447fbbb9a30e1bc1fc78 Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-TestMinimumBasicScenario-887207208-project Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 4c2cdf754ca24afd88329cd456f1c9d2 Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-TestMinimumBasicScenario-887207208-project Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:20:42.357959 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb is not attached to volume d22de2d3-0bdd-42ea-b9e9-b869c00c5edf Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'server_id': '47c03a62-cc05-4783-986b-603c9a4eeccb', 'id': 'd22de2d3-0bdd-42ea-b9e9-b869c00c5edf'} Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d22de2d3-0bdd-42ea-b9e9-b869c00c5edf. Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:20:42.358694 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb is not attached to volume d22de2d3-0bdd-42ea-b9e9-b869c00c5edf Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb is not attached to volume d22de2d3-0bdd-42ea-b9e9-b869c00c5edf Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:42.359870 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Returning 404 to user: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb is not attached to volume d22de2d3-0bdd-42ea-b9e9-b869c00c5edf {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:20:42.360853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-7e8f685b-3b5a-46a7-aa00-ee28534dac0d tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments/d22de2d3-0bdd-42ea-b9e9-b869c00c5edf" status: 404 len: 154 microversion: 2.1 time: 0.092734 Jul 21 23:20:42.360853 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1430/3002] 10.222.0.42 () {58 vars in 1415 bytes} [Thu Jul 21 23:20:42 2022] DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb/os-volume_attachments/d22de2d3-0bdd-42ea-b9e9-b869c00c5edf => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:20:43.491811 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:43.492303 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:43.499817 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:43.500263 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:43.501110 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:43.501558 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:43.526111 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Going to try to terminate instance {{(pid=124535) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 23:20:43.599324 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-5d952547-a4da-47c4-ac30-de95a45136c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 204 len: 0 microversion: 2.1 time: 0.110908 Jul 21 23:20:43.600257 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1573/3003] 10.222.0.42 () {58 vars in 1238 bytes} [Thu Jul 21 23:20:43 2022] DELETE /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 23:20:43.608656 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:43.609270 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:43.615626 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:43.616093 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:43.616874 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:43.617315 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:43.745190 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:43.753496 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-1cf11dcb-adf5-4637-bbea-fb0cf90eae11 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1554 microversion: 2.1 time: 0.149018 Jul 21 23:20:43.754056 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1431/3004] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:43 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:44.771821 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:44.772440 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.compute.api [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124535) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:44.780667 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:44.781117 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:44.781873 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:44.782311 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:44.909535 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.policy [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124535) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:44.916942 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-ac41e82d-1b3d-450b-9a18-da642c7370d2 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1554 microversion: 2.1 time: 0.149354 Jul 21 23:20:44.917496 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1574/3005] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:44 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:45.934832 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:45.935555 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:45.942073 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:45.942527 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:45.943294 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:45.943734 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:46.167448 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [req-45078356-c0c7-49d6-98ca-1c93eef645ce req-eae1396e-4590-4281-a077-c28abd88cea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47c03a62-cc05-4783-986b-603c9a4eeccb", "name": "network-vif-deleted", "tag": "0dbee7c0-bac8-4e3a-bd28-031ee36af53a"}]} {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 23:20:46.168590 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.policy [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c2cdf754ca24afd88329cd456f1c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72850690b7f447fbbb9a30e1bc1fc78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124534) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 23:20:46.177761 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-45078356-c0c7-49d6-98ca-1c93eef645ce req-eae1396e-4590-4281-a077-c28abd88cea0 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:46.178201 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG oslo_concurrency.lockutils [req-45078356-c0c7-49d6-98ca-1c93eef645ce req-eae1396e-4590-4281-a077-c28abd88cea0 service nova] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:46.178742 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-cc396762-cdfe-49f6-b858-557162cc7831 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 200 len: 1554 microversion: 2.1 time: 0.248870 Jul 21 23:20:46.179329 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1432/3006] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:45 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 23:20:46.191502 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.compute.server_external_events [req-45078356-c0c7-49d6-98ca-1c93eef645ce req-eae1396e-4590-4281-a077-c28abd88cea0 service nova] Creating event network-vif-deleted:0dbee7c0-bac8-4e3a-bd28-031ee36af53a for instance 47c03a62-cc05-4783-986b-603c9a4eeccb on hv-cinder-85069 Jul 21 23:20:46.196613 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [req-45078356-c0c7-49d6-98ca-1c93eef645ce req-eae1396e-4590-4281-a077-c28abd88cea0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Jul 21 23:20:46.197461 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1575/3007] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Jul 21 23:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 23:20:47.195378 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '>' {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:47.195983 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.compute.api [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] [instance: 47c03a62-cc05-4783-986b-603c9a4eeccb] Fetching instance by UUID {{(pid=124534) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 23:20:47.203047 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:47.203495 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:47.204535 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 23:20:47.204976 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG oslo_concurrency.lockutils [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Lock "4803857f-df2d-488f-a38b-a8f790f3829e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 23:20:47.219233 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.wsgi [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] HTTP exception thrown: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Request method failure captured: Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: request: GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb HTTP/1.1 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept: application/json Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Accept-Encoding: identity Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Connection: close Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Length: 0 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Content-Type: application/json Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Host: 10.222.0.42 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Openstack-System-Scope: None Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: User-Agent: python-urllib3/1.26.9 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Auth-Token: gAAAAABi2d7P1VmkY3FdFPEpGT5gigRM5iEI-Ym_UmSjOPD3qC2eCyIKtIuSEl0Q7XCo6wORNxrZWozy5C0iRJYZ7lefG0xS1nn5PKjnAByiAsT0dLQY27__cfxP8DceaFZ3F6yZn3n1Am8ADBOjIcwPlFS_mJiK-pPeY0OuE2V_zFHpuDPr1ic Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Id: None Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Domain-Name: None Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Identity-Status: Confirmed Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Is-Admin-Project: True Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Id: default Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Domain-Name: Default Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Id: d72850690b7f447fbbb9a30e1bc1fc78 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Project-Name: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Role: reader,member Jul 21 23:20:47.220797 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Roles: reader,member Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d72850690b7f447fbbb9a30e1bc1fc78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}] Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Id: d72850690b7f447fbbb9a30e1bc1fc78 Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887207208 Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User: tempest-TestMinimumBasicScenario-887207208-project Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Id: default Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Domain-Name: Default Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Id: 4c2cdf754ca24afd88329cd456f1c9d2 Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: X-User-Name: tempest-TestMinimumBasicScenario-887207208-project Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: method: > Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: exception: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. Jul 21 23:20:47.222107 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: action_args: {'id': '47c03a62-cc05-4783-986b-603c9a4eeccb'} Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: {{(pid=124534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 23:20:47.222744 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. Jul 21 23:20:47.223729 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: ERROR nova.api.openstack.wsgi Jul 21 23:20:47.224701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: DEBUG nova.api.openstack.wsgi [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Returning 404 to user: Instance 47c03a62-cc05-4783-986b-603c9a4eeccb could not be found. {{(pid=124534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 23:20:47.224701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO nova.api.openstack.requestlog [None req-c061548f-349c-4d19-831b-44270942a5c0 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb" status: 404 len: 111 microversion: 2.1 time: 0.030676 Jul 21 23:20:47.224701 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: [pid: 124534|app: 0|req: 1433/3008] 10.222.0.42 () {58 vars in 1235 bytes} [Thu Jul 21 23:20:47 2022] GET /compute/v2.1/servers/47c03a62-cc05-4783-986b-603c9a4eeccb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 23:20:47.232402 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: DEBUG nova.api.openstack.wsgi [None req-294b86a0-cd5c-4795-90a0-0de7f6cd5cf6 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] Calling method '.version_select at 0x7ff1dd1a9e50>' {{(pid=124535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 23:20:47.249923 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO nova.api.openstack.requestlog [None req-294b86a0-cd5c-4795-90a0-0de7f6cd5cf6 tempest-TestMinimumBasicScenario-887207208 tempest-TestMinimumBasicScenario-887207208-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907951686" status: 202 len: 0 microversion: 2.1 time: 0.022445 Jul 21 23:20:47.250481 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: [pid: 124535|app: 0|req: 1576/3009] 10.222.0.42 () {58 vars in 1271 bytes} [Thu Jul 21 23:20:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1907951686 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 23:22:23.323291 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:22:23.323851 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:22:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:22:43.817598 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 21 23:22:43.818240 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:22:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:22:55.954655 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:22:55.955328 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:22:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:23:56.548501 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:23:56.548964 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:23:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:24:07.862052 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:24:07.862569 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:24:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:25:43.332271 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:25:43.332878 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:26:03.825768 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:26:03.826405 dv-cinder-850696-1-iscsi devstack@n-api.service[124534]: Thu Jul 21 23:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 23:26:04.193264 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 23:26:04.193758 dv-cinder-850696-1-iscsi devstack@n-api.service[124535]: Thu Jul 21 23:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!